sapi · GPT-6 Sol run 3

40.7Library score
Pass rate90.6%
Simplicity47.4
Problems $$2.31
Library $$0.25
The library
sapi · designed by GPT-6 Sol (mini-SWE)805 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE93.5%50.8$0.79
43.7
GLM 5.3 Flash · mini-SWE84.4%48.7$0.86
39.8
GPT-5.6 Luna · Codex93.9%42.9$0.66
38.6
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
fleet-api29.334.922.428.9telemetry-api57.973.451.360.9catalog-search42.045.934.140.7delivery-profile33.827.327.929.7shipment-preview21.00.024.115.0protected-notes44.939.142.342.1sensor-export25.830.023.426.4versioned-orders59.446.029.445.0browser-sessions40.541.626.736.3signed-webhook84.555.285.575.1service-catalog41.944.857.147.9