umami · Grok 4.6 run 2

46.0Library score
Pass rate95.1%
Simplicity50.9
Problems $$8.82
Library $$1.92
The library
umami · designed by Grok 4.6 (mini-SWE)2,402 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.4%59.0$2.39
54.5
GLM 5.3 Flash · mini-SWE92.4%47.0$4.70
41.2
GPT-5.6 Luna · Codex95.4%46.6$1.74
42.3
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications32.938.030.833.9log-worker-pool77.647.436.053.7backup-transfer28.225.920.024.7session-mailboxes57.744.543.548.5logger-shutdown39.035.830.635.1transport-ingress62.741.339.948.0server-output62.854.877.264.9packet-colors58.152.842.751.2client-routing55.339.441.545.4request-reservation41.333.736.237.1sync-progress45.534.035.838.4game-event-lanes68.542.653.654.9ui-event-bridge90.952.275.472.8network-bridge52.147.035.444.8logger-drain45.529.832.335.9discord-subscriptions47.443.041.243.9game-session63.752.643.053.1consumer-flow52.764.053.956.8chain-sync-poller41.32.340.227.9editor-commands66.742.236.848.6