–

wapi · No library run 2

33.0Library score
Pass rate62.2%
Simplicity66.9
Problems $$5.39

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE70.4%64.9$0.81
38.0
GLM 5.3 Flash · mini-SWE52.9%68.9$2.82
27.8
GPT-5.6 Luna · Codex63.1%66.8$1.76
33.2
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.