–

rubberband · No library run 3

39.6Library score
Pass rate88.3%
Simplicity50.8
Problems $$6.36

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE91.3%48.5$1.20
41.6
GLM 5.3 Flash · mini-SWE86.7%51.7$4.09
34.7
GPT-5.6 Luna · Codex86.7%52.5$1.08
42.4
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.