–

roadkill · No library run 2

7.8Library score
Pass rate57.9%
Simplicity25.2
Problems $$4.79

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE60.7%20.5$1.49
7.8
GLM 5.3 Flash · mini-SWE58.0%25.5$2.22
4.9
GPT-5.6 Luna · Codex54.9%30.0$1.09
10.7
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.