umami · DeepSeek V4 Pro run 1

45.2Library score
Pass rate93.6%
Simplicity51.8
Problems $$7.02
Library $$0.24
The library
umami · designed by DeepSeek V4 Pro (mini-SWE)1,266 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.7%57.0$2.36
54.1
GLM 5.3 Flash · mini-SWE89.2%50.3$3.01
39.3
GPT-5.6 Luna · Codex92.6%48.2$1.65
42.1
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications54.829.132.038.6log-worker-pool57.855.839.951.1backup-transfer29.129.632.530.4session-mailboxes44.328.030.234.2logger-shutdown37.639.432.836.6transport-ingress49.90.133.727.9server-output85.621.684.463.9packet-colors50.749.72.034.1client-routing51.457.733.547.5request-reservation55.253.550.853.2sync-progress45.735.536.039.1game-event-lanes63.242.571.959.2ui-event-bridge84.874.063.274.0network-bridge52.648.745.849.0logger-drain47.925.131.034.7discord-subscriptions62.851.642.352.2game-session55.847.044.849.2consumer-flow58.566.150.758.4chain-sync-poller44.631.432.136.0editor-commands50.00.052.034.0