sapi · DeepSeek V4 Pro run 2

23.8Library score
Pass rate95.1%
Simplicity27.1
Problems $$2.95
Library $$0.33
The library
sapi · designed by DeepSeek V4 Pro (mini-SWE)1,841 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.3%27.8$1.02
26.2
GLM 5.3 Flash · mini-SWE91.6%27.6$0.99
21.4
GPT-5.6 Luna · Codex96.2%25.8$0.94
23.8
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
fleet-api17.630.214.420.7telemetry-api32.034.823.130.0catalog-search25.519.220.821.8delivery-profile16.315.417.816.5shipment-preview21.823.318.921.4protected-notes24.224.028.025.4sensor-export24.416.124.521.7versioned-orders29.735.129.031.3browser-sessions27.411.826.221.8signed-webhook35.70.037.124.3service-catalog33.225.821.626.9