sapi · Grok 4.6 run 1

37.3Library score
Pass rate93.1%
Simplicity43.0
Problems $$5.11
Library $$2.53
The library
sapi · designed by Grok 4.6 (mini-SWE)5,716 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE93.9%41.6$1.63
36.8
GLM 5.3 Flash · mini-SWE91.1%45.1$2.35
37.3
GPT-5.6 Luna · Codex94.3%42.3$1.13
37.6
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
fleet-api46.655.035.845.8telemetry-api54.361.755.557.1catalog-search30.333.336.333.3delivery-profile26.425.427.526.5shipment-preview22.522.524.323.1protected-notes30.136.740.535.8sensor-export26.317.336.226.6versioned-orders43.830.749.741.4browser-sessions35.529.427.830.9signed-webhook54.662.841.853.1service-catalog34.835.938.136.3