sapi · Opus 5.5 run 1

41.8Library score
Pass rate92.7%
Simplicity49.0
Problems $$3.03
Library $$8.04
The library
sapi · designed by Opus 5.5 (mini-SWE)5,940 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE93.5%48.6$0.70
42.2
GLM 5.3 Flash · mini-SWE91.5%50.7$1.25
41.8
GPT-5.6 Luna · Codex93.0%47.8$1.08
41.3
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
fleet-api56.637.343.845.9telemetry-api55.948.757.153.9catalog-search29.841.336.735.9delivery-profile25.135.044.534.8shipment-preview24.225.017.622.3protected-notes46.642.546.345.2sensor-export39.935.023.632.9versioned-orders28.043.661.044.2browser-sessions39.842.837.640.1signed-webhook78.761.744.161.5service-catalog40.046.642.142.9