umami · Opus 5.5 run 1

50.1Library score
Pass rate94.2%
Simplicity57.5
Problems $$7.14
Library $$8.77
The library
umami · designed by Opus 5.5 (mini-SWE)2,742 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.2%63.5$1.59
59.6
GLM 5.3 Flash · mini-SWE92.9%58.8$4.02
47.2
GPT-5.6 Luna · Codex92.5%50.4$1.53
43.7
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications53.132.244.843.4log-worker-pool70.361.934.955.7backup-transfer23.920.928.924.5session-mailboxes60.374.256.863.8logger-shutdown39.645.532.339.1transport-ingress65.948.345.953.4server-output86.176.847.770.2packet-colors70.84.24.326.4client-routing37.354.552.648.1request-reservation67.248.449.455.0sync-progress38.434.035.135.8game-event-lanes54.164.352.657.0ui-event-bridge87.569.461.572.8network-bridge63.532.242.946.2logger-drain44.846.833.041.5discord-subscriptions76.070.151.265.8game-session71.446.849.756.0consumer-flow51.255.859.455.5chain-sync-poller46.90.050.632.5editor-commands83.857.440.060.4