P

umami · Production library run 1

46.4Library score
Pass rate92.8%
Simplicity53.9
Problems $$8.26

Implementers use the real production library (unagi-chan).

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE96.4%58.1$1.30
53.6
GLM 5.3 Flash · mini-SWE91.5%54.3$5.09
44.4
GPT-5.6 Luna · Codex90.4%49.4$1.87
41.3
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications55.025.956.845.9log-worker-pool67.562.146.458.7backup-transfer30.222.538.530.4session-mailboxes51.554.837.247.8logger-shutdown30.78.743.927.8transport-ingress67.162.040.556.5server-output84.178.650.671.1packet-colors55.30.054.336.5client-routing68.544.530.747.9request-reservation25.921.221.722.9sync-progress38.028.436.634.3game-event-lanes50.753.039.547.7ui-event-bridge68.075.452.065.1network-bridge40.140.243.041.1logger-drain34.645.234.838.2discord-subscriptions50.965.946.254.3game-session83.063.562.669.7consumer-flow62.826.50.029.8chain-sync-poller45.543.649.046.1editor-commands61.865.842.456.6