–

heretical · No library run 2

32.1Library score
Pass rate90.9%
Simplicity39.3
Problems $$6.45

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE94.0%40.6$2.10
35.9
GLM 5.3 Flash · mini-SWE86.9%40.7$2.90
29.5
GPT-5.6 Luna · Codex91.6%36.7$1.46
30.8
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.