–

simu · No library run 2

38.6Library score
Pass rate85.4%
Simplicity55.0
Problems $$2.68

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE85.1%55.0$1.01
42.0
GLM 5.3 Flash · mini-SWE89.8%59.9$0.89
36.8
GPT-5.6 Luna · Codex82.3%51.1$0.77
36.9
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.