P

umami · Production library run 2

43.5Library score
Pass rate94.5%
Simplicity50.6
Problems $$10.38

Implementers use the real production library (unagi-chan).

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE96.7%54.7$1.32
51.5
GLM 5.3 Flash · mini-SWE95.3%48.0$7.12
36.6
GPT-5.6 Luna · Codex91.5%48.8$1.94
42.2
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications51.236.343.643.7log-worker-pool56.649.050.452.0backup-transfer29.525.330.528.4session-mailboxes48.50.035.428.0logger-shutdown40.830.346.639.2transport-ingress55.176.453.361.6server-output73.680.980.278.2packet-colors77.651.81.943.8client-routing72.541.434.949.6request-reservation20.718.619.119.5sync-progress44.442.934.140.4game-event-lanes45.436.050.644.0ui-event-bridge67.752.264.261.3network-bridge40.830.230.934.0logger-drain36.30.037.024.4discord-subscriptions40.739.752.744.3game-session58.445.747.050.4consumer-flow75.145.357.359.2chain-sync-poller38.90.028.222.4editor-commands57.330.846.845.0