umami · Fable 5.1 run 2
48.4Library score
Pass rate94.6%
Simplicity54.7
Problems $$9.68
Library $$11.85
The library
umami · designed by Fable 5.1 (mini-SWE)2,252 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.5%60.3$1.70
GLM 5.3 Flash · mini-SWE93.1%51.5$6.13
GPT-5.6 Luna · Codex92.2%52.1$1.84
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications57.244.755.052.3log-worker-pool46.353.831.343.8backup-transfer31.129.140.133.4session-mailboxes72.159.844.858.9logger-shutdown37.539.336.937.9transport-ingress60.439.851.150.4server-output85.880.858.475.0packet-colors55.03.653.137.2client-routing59.273.837.957.0request-reservation50.532.017.433.3sync-progress49.745.245.046.7game-event-lanes63.242.056.954.0ui-event-bridge81.357.470.969.9network-bridge48.335.243.842.4logger-drain35.240.831.135.7discord-subscriptions85.00.050.345.1game-session64.656.554.158.4consumer-flow45.652.655.451.2chain-sync-poller53.736.341.343.8editor-commands62.148.415.742.1