P

npr · Production library run 3

50.5Library score
Pass rate88.0%
Simplicity60.6
Problems $$9.20

Implementers use the real production library (ndarray).

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE84.8%58.3$1.98
48.8
GLM 5.3 Flash · mini-SWE92.9%59.7$5.64
52.9
GPT-5.6 Luna · Codex86.1%63.8$1.58
50.0
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.