sapi · DeepSeek V4 Pro run 1

19.8Library score
Pass rate96.2%
Simplicity22.7
Problems $$3.79
Library $$0.32
The library
sapi · designed by DeepSeek V4 Pro (mini-SWE)2,982 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.0%20.4$1.54
19.6
GLM 5.3 Flash · mini-SWE94.3%25.0$1.27
20.1
GPT-5.6 Luna · Codex96.2%23.0$0.97
19.5
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
fleet-api18.820.714.317.9telemetry-api20.423.325.723.1catalog-search19.126.420.522.0delivery-profile19.60.017.512.4shipment-preview10.411.29.510.3protected-notes18.120.320.319.6sensor-export22.022.00.014.7versioned-orders20.921.626.923.1browser-sessions23.716.820.020.2signed-webhook27.940.338.935.7service-catalog14.919.121.218.4