umami · GLM 5.3 run 2
48.2Library score
Pass rate96.6%
Simplicity51.7
Problems $$8.50
Library $$38.86
The library
umami · designed by GLM 5.3 (mini-SWE)3,390 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.4%57.8$2.79
GLM 5.3 Flash · mini-SWE96.3%48.5$4.02
GPT-5.6 Luna · Codex95.0%48.8$1.68
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications53.545.031.943.5log-worker-pool79.058.548.361.9backup-transfer21.324.228.124.5session-mailboxes72.856.640.556.6logger-shutdown41.130.622.731.5transport-ingress62.346.337.848.8server-output79.280.058.872.7packet-colors48.850.436.445.2client-routing50.256.236.547.6request-reservation56.538.635.743.6sync-progress43.336.045.041.4game-event-lanes57.343.360.653.7ui-event-bridge75.968.962.669.1network-bridge42.733.730.635.7logger-drain43.433.029.335.2discord-subscriptions67.037.361.055.1game-session49.956.160.655.5consumer-flow59.44.557.640.5chain-sync-poller36.855.034.742.2editor-commands62.355.661.759.8