–

rubberband · No library run 1

40.5Library score
Pass rate89.9%
Simplicity48.3
Problems $$6.03

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE95.0%46.5$1.00
42.1
GLM 5.3 Flash · mini-SWE84.3%46.9$4.03
35.3
GPT-5.6 Luna · Codex90.4%51.6$1.00
44.2
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.