umami · DeepSeek V4 Pro run 2

45.7Library score
Pass rate95.7%
Simplicity51.1
Problems $$6.22
Library $$0.26
The library
umami · designed by DeepSeek V4 Pro (mini-SWE)983 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.5%54.9$2.28
53.0
GLM 5.3 Flash · mini-SWE95.8%51.5$2.58
43.9
GPT-5.6 Luna · Codex92.7%46.8$1.36
40.3
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications44.430.630.735.2log-worker-pool51.360.840.750.9backup-transfer28.323.033.528.2session-mailboxes51.140.937.543.2logger-shutdown41.940.826.736.5transport-ingress52.351.641.148.3server-output78.454.161.264.6packet-colors55.742.551.449.9client-routing55.257.933.648.9request-reservation40.831.031.934.6sync-progress39.040.239.139.4game-event-lanes80.040.167.362.5ui-event-bridge76.788.271.278.7network-bridge42.249.937.243.1logger-drain41.329.033.534.6discord-subscriptions63.70.048.937.6game-session60.445.243.449.7consumer-flow54.765.130.350.0chain-sync-poller41.334.933.036.4editor-commands61.652.413.942.6