umami · Grok 4.6 run 3

46.0Library score
Pass rate93.6%
Simplicity51.3
Problems $$8.11
Library $$1.05
The library
umami · designed by Grok 4.6 (mini-SWE)2,075 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.0%58.8$2.48
55.8
GLM 5.3 Flash · mini-SWE92.1%46.1$4.25
40.6
GPT-5.6 Luna · Codex90.6%49.0$1.38
41.6
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications52.625.235.537.8log-worker-pool38.652.036.342.3backup-transfer32.428.332.531.1session-mailboxes47.045.245.545.9logger-shutdown29.634.232.932.2transport-ingress68.347.243.352.9server-output84.970.987.881.2packet-colors70.03.72.025.2client-routing65.564.334.654.8request-reservation44.741.556.747.6sync-progress60.839.633.044.5game-event-lanes55.846.256.552.8ui-event-bridge85.867.265.572.9network-bridge55.517.335.236.0logger-drain32.831.437.133.8discord-subscriptions87.842.942.657.8game-session46.751.447.048.3consumer-flow48.734.457.847.0chain-sync-poller44.833.032.236.7editor-commands63.735.717.538.9