sapi · GPT-6 Astra run 3

43.0Library score
Pass rate95.1%
Simplicity47.4
Problems $$3.26
Library $$3.93
The library
sapi · designed by GPT-6 Astra (Codex)1,935 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE95.9%47.9$0.80
44.3
GLM 5.3 Flash · mini-SWE94.7%45.6$1.62
41.1
GPT-5.6 Luna · Codex94.7%48.8$0.84
43.6
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
fleet-api32.543.330.835.5telemetry-api66.875.165.369.1catalog-search33.136.638.836.2delivery-profile34.429.930.331.6shipment-preview31.123.721.825.5protected-notes48.131.636.838.8sensor-export26.329.334.530.0versioned-orders56.141.755.351.0browser-sessions46.639.934.240.2signed-webhook73.969.284.575.8service-catalog38.132.147.039.1