P

sapi · Production library run 1

49.7Library score
Pass rate97.0%
Simplicity52.6
Problems $$2.31

Implementers use the real production library (fastapi).

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE96.8%56.6$0.52
53.1
GLM 5.3 Flash · mini-SWE96.9%56.1$0.89
53.5
GPT-5.6 Luna · Codex97.2%45.0$0.90
42.6
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.