P
npr · Production library run 2
46.2Library score
Pass rate83.6%
Simplicity60.5
Problems $$8.82
Implementers use the real production library (ndarray).
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE85.8%62.3$1.80
GLM 5.3 Flash · mini-SWE83.9%59.5$5.48
GPT-5.6 Luna · Codex81.1%59.7$1.55
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
Click a problem to see how each solution's score is built.