sapi · GPT-6 Astra run 2

39.8Library score
Pass rate95.5%
Simplicity44.5
Problems $$3.01
Library $$4.14
The library
sapi · designed by GPT-6 Astra (Codex)1,930 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE95.5%42.8$0.89
38.6
GLM 5.3 Flash · mini-SWE95.6%51.3$1.29
45.1
GPT-5.6 Luna · Codex95.5%39.6$0.83
35.8
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
fleet-api29.139.532.833.8telemetry-api65.764.548.859.7catalog-search30.732.326.229.7delivery-profile30.832.525.629.6shipment-preview17.046.328.830.7protected-notes35.833.530.233.2sensor-export22.223.825.723.9versioned-orders62.557.053.957.8browser-sessions35.553.632.640.6signed-webhook57.471.153.160.5service-catalog37.742.635.838.7