–

arazu · No library run 2

21.9Library score
Pass rate74.2%
Simplicity42.1
Problems $$12.46

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE77.2%36.5$1.81
23.3
GLM 5.3 Flash · mini-SWE68.5%44.2$7.99
18.1
GPT-5.6 Luna · Codex76.2%46.0$2.66
24.3
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.