P
canon · Production library run 2
59.4Library score
Pass rate91.6%
Simplicity68.9
Problems $$4.85
Implementers use the real production library (pydantic).
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE96.1%71.9$0.98
GLM 5.3 Flash · mini-SWE94.8%72.3$2.49
GPT-5.6 Luna · Codex83.9%62.5$1.38
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
Click a problem to see how each solution's score is built.