umami · Opus 5.5 run 3

48.8Library score
Pass rate94.2%
Simplicity54.8
Problems $$7.31
Library $$13.00
The library
umami · designed by Opus 5.5 (mini-SWE)3,227 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.0%58.7$1.57
55.9
GLM 5.3 Flash · mini-SWE90.4%53.2$4.07
42.9
GPT-5.6 Luna · Codex94.8%52.5$1.67
47.6
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications57.944.138.146.7log-worker-pool66.553.134.051.2backup-transfer25.022.827.725.1session-mailboxes52.641.048.547.3logger-shutdown37.341.336.338.3transport-ingress51.757.446.451.8server-output81.571.585.879.6packet-colors63.444.641.049.7client-routing60.744.339.848.3request-reservation18.155.819.131.0sync-progress47.00.245.130.8game-event-lanes55.643.953.451.0ui-event-bridge100.074.565.880.1network-bridge60.439.835.945.4logger-drain46.931.637.038.5discord-subscriptions75.836.055.955.9game-session70.00.069.546.5consumer-flow51.155.064.556.9chain-sync-poller35.942.450.943.1editor-commands61.159.058.359.5