umami · Kimi K3 run 3

51.3Library score
Pass rate97.4%
Simplicity55.1
Problems $$6.86
Library $$4.35
The library
umami · designed by Kimi K3 (mini-SWE)1,219 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.6%58.5$1.84
54.9
GLM 5.3 Flash · mini-SWE98.2%55.6$3.61
52.1
GPT-5.6 Luna · Codex96.3%51.3$1.41
46.8
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications50.436.349.445.4log-worker-pool50.149.535.445.0backup-transfer24.238.128.130.1session-mailboxes61.556.758.758.9logger-shutdown41.639.050.543.7transport-ingress54.342.644.547.1server-output87.485.457.976.9packet-colors53.148.952.051.3client-routing66.067.630.854.8request-reservation47.140.847.845.2sync-progress39.441.544.941.9game-event-lanes64.261.051.458.9ui-event-bridge87.085.445.572.7network-bridge40.949.938.843.2logger-drain50.949.534.444.9discord-subscriptions57.954.451.554.6game-session69.660.663.864.7consumer-flow27.146.158.944.0chain-sync-poller58.850.941.950.5editor-commands66.238.149.751.3