umami · GPT-6 Astra run 1

47.1Library score
Pass rate95.4%
Simplicity51.9
Problems $$9.26
Library $$4.10
The library
umami · designed by GPT-6 Astra (Codex)894 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.6%56.7$1.65
53.1
GLM 5.3 Flash · mini-SWE92.7%48.4$6.10
41.3
GPT-5.6 Luna · Codex95.9%50.6$1.51
47.0
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications78.326.843.849.6log-worker-pool55.245.735.545.5backup-transfer27.520.028.825.4session-mailboxes67.249.051.255.8logger-shutdown42.922.530.932.1transport-ingress63.149.552.254.9server-output61.459.086.769.0packet-colors56.948.959.054.9client-routing58.346.333.646.0request-reservation46.541.637.541.9sync-progress37.029.638.335.0game-event-lanes51.251.654.952.6ui-event-bridge81.566.878.275.5network-bridge50.839.244.844.9logger-drain45.736.037.739.8discord-subscriptions58.231.637.942.6game-session41.160.259.753.7consumer-flow55.651.160.955.9chain-sync-poller36.53.131.523.7editor-commands47.446.437.943.9