–

arazu · No library run 1

22.0Library score
Pass rate76.3%
Simplicity41.5
Problems $$11.58

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE80.4%35.4$1.81
22.9
GLM 5.3 Flash · mini-SWE73.3%45.9$6.76
19.7
GPT-5.6 Luna · Codex74.7%43.7$3.00
23.5
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.