–

arazu · No library run 3

23.0Library score
Pass rate75.5%
Simplicity42.0
Problems $$11.04

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE82.4%34.7$1.63
23.1
GLM 5.3 Flash · mini-SWE65.6%49.9$6.46
20.3
GPT-5.6 Luna · Codex77.1%42.5$2.95
25.5
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.