–

canon · No library run 3

35.1Library score
Pass rate95.0%
Simplicity38.4
Problems $$2.05

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.3%38.8$0.62
37.5
GLM 5.3 Flash · mini-SWE92.1%41.0$0.82
35.2
GPT-5.6 Luna · Codex94.8%35.4$0.62
32.8
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.