–

roadkill · No library run 3

6.5Library score
Pass rate54.3%
Simplicity26.9
Problems $$5.05

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE53.5%24.8$1.54
6.5
GLM 5.3 Flash · mini-SWE59.4%26.7$2.49
4.6
GPT-5.6 Luna · Codex53.1%29.1$1.03
8.5
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.