sapi · GPT-6 Sol run 1

38.1Library score
Pass rate94.0%
Simplicity42.8
Problems $$2.37
Library $$0.23
The library
sapi · designed by GPT-6 Sol (mini-SWE)728 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE93.9%43.4$0.74
38.6
GLM 5.3 Flash · mini-SWE93.1%47.9$0.96
41.9
GPT-5.6 Luna · Codex95.1%37.1$0.68
33.7
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
fleet-api33.650.830.238.2telemetry-api58.064.345.455.9catalog-search32.436.631.433.5delivery-profile25.927.520.524.6shipment-preview16.025.623.321.6protected-notes34.544.938.639.3sensor-export39.132.127.032.7versioned-orders47.248.337.044.1browser-sessions46.447.533.542.5signed-webhook59.154.147.453.6service-catalog31.928.736.732.5