P

sapi · Production library run 2

48.1Library score
Pass rate96.8%
Simplicity51.5
Problems $$2.44

Implementers use the real production library (fastapi).

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.2%54.9$0.58
51.8
GLM 5.3 Flash · mini-SWE96.9%53.1$1.06
49.2
GPT-5.6 Luna · Codex96.4%46.5$0.81
43.4
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.