sapi · Grok 4.6 run 2

32.2Library score
Pass rate90.3%
Simplicity39.1
Problems $$3.71
Library $$3.47
The library
sapi · designed by Grok 4.6 (mini-SWE)4,521 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE93.5%41.7$1.46
35.6
GLM 5.3 Flash · mini-SWE83.6%38.8$1.21
28.8
GPT-5.6 Luna · Codex93.7%36.9$1.03
32.2
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
fleet-api25.435.831.430.9telemetry-api36.346.941.841.7catalog-search23.721.323.122.7delivery-profile26.617.421.621.9shipment-preview32.936.328.332.5protected-notes35.127.823.128.7sensor-export40.024.329.031.1versioned-orders56.80.051.736.1browser-sessions25.929.635.830.4signed-webhook60.449.547.752.5service-catalog28.427.821.225.8