canon · DeepSeek V4 Pro run 2
32.0Library score
Pass rate91.3%
Simplicity38.2
Problems $$4.67
Library $$0.20
The library
canon · designed by DeepSeek V4 Pro (mini-SWE)1,234 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE92.5%41.5$2.09
GLM 5.3 Flash · mini-SWE91.5%41.1$1.45
GPT-5.6 Luna · Codex90.1%32.3$1.13
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
profile-patch47.655.00.734.5thermostat-codec33.031.720.328.3tagged-config52.749.625.642.6rtl-pin-lock45.60.039.028.2pipeline-provenance4.94.722.610.7boundary-views23.724.514.921.0ml-run-config53.650.553.052.4ha-triggers36.547.837.240.5env-config53.60.042.732.1paper-poster36.742.141.140.0typed-client33.131.416.026.8cli-dispatch27.127.923.926.3trading-events40.236.025.133.8llm-contracts28.332.331.530.7