–
wapi · No library run 1
29.4Library score
Pass rate61.3%
Simplicity65.6
Problems $$5.68
Implementers get no library and write everything from scratch.
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE62.6%65.2$0.91
GLM 5.3 Flash · mini-SWE54.9%68.7$3.04
GPT-5.6 Luna · Codex66.4%62.9$1.73
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
Click a problem to see how each solution's score is built.