sapi · GPT-6 Astra run 2

41.7Library score
Pass rate96.2%
Simplicity45.4
Problems $$2.46
Library $$4.73
The library
sapi · designed by GPT-6 Astra (mini-SWE)2,122 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE96.7%48.3$0.64
44.6
GLM 5.3 Flash · mini-SWE95.5%46.8$0.94
42.2
GPT-5.6 Luna · Codex96.4%41.2$0.87
38.4
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
fleet-api45.038.024.035.6telemetry-api69.660.249.959.9catalog-search35.238.236.036.5delivery-profile27.132.125.628.3shipment-preview23.731.315.723.5protected-notes50.555.937.247.9sensor-export41.126.447.138.2versioned-orders39.045.750.645.1browser-sessions47.941.632.440.6signed-webhook73.066.159.666.2service-catalog38.428.644.837.3