P

wapi · Production library run 3

27.3Library score
Pass rate48.3%
Simplicity77.5
Problems $$20.43

Implementers use the real production library (servant).

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE33.0%76.5$1.74
20.2
GLM 5.3 Flash · mini-SWE60.1%73.5$14.86
28.3
GPT-5.6 Luna · Codex52.9%82.2$3.83
33.3
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.