–
sapi · No library run 3
20.4Library score
Pass rate96.1%
Simplicity22.3
Problems $$1.41
Implementers get no library and write everything from scratch.
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.4%22.1$0.36
GLM 5.3 Flash · mini-SWE93.1%23.1$0.54
GPT-5.6 Luna · Codex96.8%21.6$0.51
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
Click a problem to see how each solution's score is built.