P
wapi · Production library run 1
27.2Library score
Pass rate48.7%
Simplicity73.4
Problems $$19.74
Implementers use the real production library (servant).
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE31.7%73.6$1.56
GLM 5.3 Flash · mini-SWE51.6%69.9$14.51
GPT-5.6 Luna · Codex62.7%76.6$3.66
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
Click a problem to see how each solution's score is built.