–

plaid · No library run 3

36.0Library score
Pass rate95.9%
Simplicity41.8
Problems $$7.60

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.1%40.8$1.40
39.0
GLM 5.3 Flash · mini-SWE95.3%43.0$4.40
31.3
GPT-5.6 Luna · Codex95.1%41.8$1.80
37.7
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.