–

rubberband · No library run 2

42.4Library score
Pass rate92.2%
Simplicity48.6
Problems $$5.77

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE90.2%48.7$0.94
41.8
GLM 5.3 Flash · mini-SWE96.3%45.4$3.71
41.0
GPT-5.6 Luna · Codex90.2%51.8$1.13
44.4
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.