–

pyda · No library run 2

50.8Library score
Pass rate94.2%
Simplicity60.5
Problems $$4.36

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE93.9%62.9$1.04
54.6
GLM 5.3 Flash · mini-SWE90.4%64.8$2.73
47.8
GPT-5.6 Luna · Codex98.1%54.1$0.58
49.9
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.