sapi · DeepSeek V4 Pro run 3
21.0Library score
Pass rate93.2%
Simplicity23.7
Problems $$3.30
Library $$0.30
The library
sapi · designed by DeepSeek V4 Pro (mini-SWE)2,097 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE96.8%23.9$1.12
GLM 5.3 Flash · mini-SWE89.0%21.6$1.28
GPT-5.6 Luna · Codex93.8%25.7$0.89
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
fleet-api23.432.113.322.9telemetry-api22.724.320.522.5catalog-search25.417.826.223.1delivery-profile16.410.621.716.2shipment-preview16.716.212.115.0protected-notes20.716.321.619.5sensor-export24.815.927.422.7versioned-orders21.425.434.026.9browser-sessions26.222.225.624.7signed-webhook28.12.032.520.8service-catalog19.113.817.616.8