sapi · GPT-6 Astra run 3

39.1Library score
Pass rate94.0%
Simplicity44.7
Problems $$2.39
Library $$3.37
The library
sapi · designed by GPT-6 Astra (mini-SWE)1,394 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE95.1%47.6$0.67
42.3
GLM 5.3 Flash · mini-SWE92.5%41.1$0.92
34.5
GPT-5.6 Luna · Codex94.3%45.5$0.79
40.5
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
fleet-api40.426.622.129.7telemetry-api52.058.444.351.6catalog-search25.825.030.527.1delivery-profile29.124.740.731.5shipment-preview17.026.425.723.1protected-notes46.047.027.440.1sensor-export27.722.842.931.1versioned-orders60.558.455.358.1browser-sessions53.624.939.539.3signed-webhook75.330.874.460.1service-catalog37.934.443.138.5