–

clirs · No library run 1

30.8Library score
Pass rate89.2%
Simplicity37.8
Problems $$2.06

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE93.6%37.8$0.60
33.2
GLM 5.3 Flash · mini-SWE81.0%41.2$0.61
29.2
GPT-5.6 Luna · Codex93.2%34.4$0.85
30.0
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.