umami · GPT-6 Astra run 3

46.1Library score
Pass rate93.8%
Simplicity52.0
Problems $$6.46
Library $$2.52
The library
umami · designed by GPT-6 Astra (mini-SWE)772 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE94.4%59.3$1.73
53.5
GLM 5.3 Flash · mini-SWE91.6%49.8$3.08
42.6
GPT-5.6 Luna · Codex95.3%47.0$1.65
42.3
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications54.066.746.355.7log-worker-pool74.346.349.656.7backup-transfer29.019.623.123.9session-mailboxes58.033.338.543.3logger-shutdown17.423.429.723.5transport-ingress53.967.122.747.9server-output90.753.458.567.5packet-colors61.442.246.750.1client-routing55.251.238.548.3request-reservation44.247.942.845.0sync-progress47.229.727.634.8game-event-lanes48.656.544.749.9ui-event-bridge75.562.253.663.8network-bridge49.437.934.040.4logger-drain40.536.040.839.1discord-subscriptions83.255.340.859.8game-session61.938.861.654.1consumer-flow57.046.648.950.8chain-sync-poller8.02.642.817.8editor-commands60.235.054.549.9