umami · GPT-6 Sol run 1

48.6Library score
Pass rate97.6%
Simplicity51.4
Problems $$7.22
Library $$0.20
The library
umami · designed by GPT-6 Sol (mini-SWE)431 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.5%56.6$1.85
54.0
GLM 5.3 Flash · mini-SWE98.8%51.2$4.04
49.9
GPT-5.6 Luna · Codex95.7%46.2$1.32
41.9
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications47.230.337.838.5log-worker-pool60.348.237.248.5backup-transfer29.317.624.923.9session-mailboxes58.547.639.148.4logger-shutdown44.041.325.436.9transport-ingress57.141.149.349.2server-output78.578.157.671.4packet-colors67.857.341.755.6client-routing48.166.630.748.5request-reservation47.963.341.450.9sync-progress44.631.138.238.0game-event-lanes54.749.851.351.9ui-event-bridge57.575.962.365.2network-bridge44.646.843.344.9logger-drain50.027.533.337.0discord-subscriptions55.656.950.554.4game-session54.940.362.452.5consumer-flow60.070.247.959.4chain-sync-poller51.355.528.645.1editor-commands66.851.534.550.9