umami · GPT-6 Astra run 3

46.9Library score
Pass rate96.5%
Simplicity51.2
Problems $$7.45
Library $$3.42
The library
umami · designed by GPT-6 Astra (Codex)905 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.9%56.5$1.70
54.8
GLM 5.3 Flash · mini-SWE97.4%49.5$4.23
45.9
GPT-5.6 Luna · Codex93.1%47.6$1.52
39.9
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications51.929.837.539.7log-worker-pool61.261.641.254.7backup-transfer24.819.519.921.4session-mailboxes53.959.041.851.6logger-shutdown34.336.821.830.9transport-ingress62.041.538.847.4server-output84.249.924.152.7packet-colors58.346.150.051.5client-routing53.243.631.342.7request-reservation38.941.343.241.1sync-progress40.134.341.138.5game-event-lanes57.955.840.551.4ui-event-bridge82.741.963.762.8network-bridge47.442.646.745.6logger-drain43.841.634.439.9discord-subscriptions71.957.854.361.3game-session63.054.457.158.2consumer-flow55.445.532.544.5chain-sync-poller46.846.839.644.4editor-commands64.367.638.956.9