P
npr · Production library run 3
50.5Library score
Pass rate88.0%
Simplicity60.6
Problems $$9.20
Implementers use the real production library (ndarray).
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE84.8%58.3$1.98
GLM 5.3 Flash · mini-SWE92.9%59.7$5.64
GPT-5.6 Luna · Codex86.1%63.8$1.58
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
Click a problem to see how each solution's score is built.