P

canon · Production library run 1

60.9Library score
Pass rate92.9%
Simplicity69.3
Problems $$4.67

Implementers use the real production library (pydantic).

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.6%72.1$0.93
68.1
GLM 5.3 Flash · mini-SWE95.8%70.3$2.38
63.9
GPT-5.6 Luna · Codex85.4%65.5$1.36
50.7
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
profile-patch73.875.32.350.5thermostat-codec82.954.210.949.3tagged-config93.175.775.881.5rtl-pin-lock72.183.993.883.3pipeline-provenance83.575.653.971.0boundary-views56.459.343.553.1ml-run-config85.388.882.285.4ha-triggers71.577.879.176.1env-config77.067.764.569.7paper-poster49.634.649.244.5typed-client52.049.024.041.7cli-dispatch39.933.138.037.0trading-events84.684.361.576.8llm-contracts32.435.831.633.3