sapi · GPT-6 Astra run 1

38.3Library score
Pass rate95.5%
Simplicity42.5
Problems $$2.78
Library $$3.40
The library
sapi · designed by GPT-6 Astra (mini-SWE)2,266 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE95.9%45.7$0.76
41.7
GLM 5.3 Flash · mini-SWE95.1%41.7$1.10
37.1
GPT-5.6 Luna · Codex95.5%39.9$0.91
36.3
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
fleet-api31.439.830.333.8telemetry-api46.756.946.950.2catalog-search31.128.023.027.3delivery-profile36.624.820.027.1shipment-preview26.819.827.124.6protected-notes47.428.831.836.0sensor-export29.826.822.426.3versioned-orders47.256.654.052.6browser-sessions50.329.327.335.6signed-webhook69.161.671.567.4service-catalog42.135.444.740.8