–

pyda · No library run 3

50.1Library score
Pass rate94.4%
Simplicity58.5
Problems $$4.10

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE95.7%61.6$1.00
54.2
GLM 5.3 Flash · mini-SWE88.7%60.0$2.45
44.9
GPT-5.6 Luna · Codex98.8%53.9$0.65
51.1
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.