P

umami · Production library run 3

44.2Library score
Pass rate93.3%
Simplicity51.8
Problems $$10.13

Implementers use the real production library (unagi-chan).

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE93.9%55.7$1.25
50.3
GLM 5.3 Flash · mini-SWE93.7%50.6$7.10
41.3
GPT-5.6 Luna · Codex92.3%49.1$1.78
40.9
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications52.827.345.141.7log-worker-pool54.355.639.549.8backup-transfer28.025.531.928.5session-mailboxes59.365.739.954.9logger-shutdown44.20.035.126.4transport-ingress43.554.527.641.9server-output85.662.874.774.4packet-colors60.424.048.444.2client-routing44.840.039.841.5request-reservation18.726.220.221.7sync-progress45.029.239.237.8game-event-lanes48.839.047.145.0ui-event-bridge71.861.462.365.1network-bridge47.227.840.038.3logger-drain13.429.829.324.2discord-subscriptions60.645.645.150.4game-session63.074.054.063.6consumer-flow58.747.730.045.5chain-sync-poller26.927.930.228.3editor-commands79.761.639.460.2