umami · GPT-6 Astra run 1
46.3Library score
Pass rate94.1%
Simplicity52.1
Problems $$5.98
Library $$3.11
The library
umami · designed by GPT-6 Astra (mini-SWE)1,103 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE93.7%59.1$1.73
GLM 5.3 Flash · mini-SWE94.9%52.3$2.62
GPT-5.6 Luna · Codex93.8%44.9$1.63
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications53.140.434.042.5log-worker-pool79.339.635.851.6backup-transfer19.219.128.222.2session-mailboxes54.958.044.252.3logger-shutdown27.325.246.933.1transport-ingress63.542.340.948.9server-output87.081.165.077.7packet-colors4.033.533.123.5client-routing41.876.434.650.9request-reservation52.033.745.543.7sync-progress32.137.737.135.6game-event-lanes52.145.140.645.9ui-event-bridge72.660.657.463.5network-bridge43.744.133.240.4logger-drain44.739.932.439.0discord-subscriptions85.039.465.463.2game-session77.755.839.557.7consumer-flow59.760.64.341.5chain-sync-poller41.638.339.039.6editor-commands65.050.044.553.2