P
wapi · Production library run 2
32.8Library score
Pass rate57.4%
Simplicity75.8
Problems $$20.96
Implementers use the real production library (servant).
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE42.3%73.9$1.65
GLM 5.3 Flash · mini-SWE60.0%74.9$15.26
GPT-5.6 Luna · Codex70.2%78.4$4.04
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
Click a problem to see how each solution's score is built.