canon · GPT-6 Astra run 2
53.2Library score
Pass rate91.6%
Simplicity60.8
Problems $$5.33
Library $$3.22
The library
canon · designed by GPT-6 Astra (mini-SWE)1,732 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE95.6%63.7$1.34
GLM 5.3 Flash · mini-SWE87.8%61.6$2.71
GPT-5.6 Luna · Codex91.5%57.0$1.28
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
profile-patch34.417.756.636.2thermostat-codec41.747.336.741.9tagged-config61.452.556.156.7rtl-pin-lock91.70.975.556.0pipeline-provenance41.335.036.637.6boundary-views70.653.447.057.0ml-run-config90.795.081.789.2ha-triggers52.272.558.461.1env-config53.867.862.061.2paper-poster58.850.143.550.8typed-client45.035.43.027.8cli-dispatch33.635.626.231.8trading-events99.294.383.292.3llm-contracts42.943.448.244.8