P
canon · Production library run 1
60.9Library score
Pass rate92.9%
Simplicity69.3
Problems $$4.67
Implementers use the real production library (pydantic).
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.6%72.1$0.93
GLM 5.3 Flash · mini-SWE95.8%70.3$2.38
GPT-5.6 Luna · Codex85.4%65.5$1.36
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
Click a problem to see how each solution's score is built.