–

roadkill · No library run 1

8.0Library score
Pass rate51.9%
Simplicity28.0
Problems $$5.90

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE56.1%27.0$1.45
9.0
GLM 5.3 Flash · mini-SWE45.0%29.1$3.41
5.5
GPT-5.6 Luna · Codex52.0%28.2$1.04
9.4
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.