–

wapi · No library run 3

40.1Library score
Pass rate72.0%
Simplicity65.3
Problems $$4.94

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE78.4%63.7$0.83
45.7
GLM 5.3 Flash · mini-SWE72.9%69.1$2.49
41.4
GPT-5.6 Luna · Codex64.7%63.1$1.62
33.2
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.