umami · Kimi K3 run 1

45.8Library score
Pass rate96.2%
Simplicity50.1
Problems $$8.49
Library $$3.44
The library
umami · designed by Kimi K3 (mini-SWE)1,505 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE96.0%57.0$1.56
53.1
GLM 5.3 Flash · mini-SWE96.4%47.2$5.36
41.7
GPT-5.6 Luna · Codex96.3%46.0$1.57
42.7
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications50.938.236.341.8log-worker-pool58.143.459.753.8backup-transfer32.118.026.225.4session-mailboxes34.00.035.923.3logger-shutdown29.133.632.231.7transport-ingress43.547.546.345.8server-output83.872.980.479.0packet-colors66.357.940.354.9client-routing50.444.929.841.7request-reservation39.341.535.838.9sync-progress46.039.735.240.3game-event-lanes78.739.749.556.0ui-event-bridge98.058.450.669.0network-bridge55.236.535.442.4logger-drain42.727.030.433.3discord-subscriptions45.960.145.950.6game-session57.342.940.446.8consumer-flow54.035.160.549.9chain-sync-poller31.156.444.043.8editor-commands64.740.738.848.1