umami · Grok 4.6 run 1

47.4Library score
Pass rate94.2%
Simplicity53.7
Problems $$7.76
Library $$1.43
The library
umami · designed by Grok 4.6 (mini-SWE)2,541 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.0%57.8$2.54
53.9
GLM 5.3 Flash · mini-SWE96.9%53.9$3.63
46.4
GPT-5.6 Luna · Codex88.8%49.5$1.59
42.0
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications50.137.541.643.0log-worker-pool32.060.646.446.3backup-transfer34.328.928.430.5session-mailboxes52.750.045.349.3logger-shutdown34.634.534.934.7transport-ingress63.160.649.457.7server-output84.556.184.375.0packet-colors54.363.84.040.7client-routing52.858.635.148.9request-reservation49.645.915.036.8sync-progress38.939.350.743.0game-event-lanes59.854.352.255.5ui-event-bridge94.358.964.572.6network-bridge55.434.340.043.2logger-drain41.233.127.934.1discord-subscriptions48.352.652.151.0game-session54.00.054.736.2consumer-flow58.154.855.456.1chain-sync-poller44.744.52.730.6editor-commands74.359.155.362.9