umami · GPT-6 Astra run 2

46.2Library score
Pass rate95.9%
Simplicity50.8
Problems $$8.10
Library $$3.45
The library
umami · designed by GPT-6 Astra (Codex)967 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.3%56.8$1.69
54.7
GLM 5.3 Flash · mini-SWE93.8%48.7$4.87
42.1
GPT-5.6 Luna · Codex95.5%46.9$1.54
41.9
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications55.834.236.342.1log-worker-pool63.245.639.149.3backup-transfer24.523.327.725.2session-mailboxes68.750.746.055.1logger-shutdown40.638.931.136.9transport-ingress65.950.140.552.2server-output83.153.280.172.1packet-colors74.64.145.441.4client-routing62.049.831.247.7request-reservation44.336.642.841.2sync-progress36.837.632.035.5game-event-lanes51.754.046.050.5ui-event-bridge68.856.555.960.4network-bridge37.042.234.637.9logger-drain35.035.435.535.3discord-subscriptions47.544.042.044.5game-session61.148.345.051.5consumer-flow53.550.932.245.6chain-sync-poller49.533.243.542.1editor-commands71.253.651.158.6