P
canon · Production library run 3
59.1Library score
Pass rate91.2%
Simplicity68.3
Problems $$4.76
Implementers use the real production library (pydantic).
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE96.2%73.5$1.03
GLM 5.3 Flash · mini-SWE90.5%67.7$2.39
GPT-5.6 Luna · Codex86.7%63.8$1.34
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
Click a problem to see how each solution's score is built.