umami · GPT-5.6 Sol run 1

48.5Library score
Pass rate96.1%
Simplicity52.4
Problems $$8.17
Library $$1.73
The library
umami · designed by GPT-5.6 Sol (Codex)921 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.6%57.3$2.31
55.3
GLM 5.3 Flash · mini-SWE96.7%50.9$4.11
46.9
GPT-5.6 Luna · Codex93.1%49.0$1.75
43.4
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications39.632.038.436.7log-worker-pool66.249.534.450.0backup-transfer31.423.537.630.8session-mailboxes56.558.746.754.0logger-shutdown38.338.225.734.0transport-ingress62.847.549.253.2server-output75.986.880.581.1packet-colors62.346.44.137.6client-routing40.057.730.142.6request-reservation44.845.649.646.7sync-progress32.943.545.240.5game-event-lanes58.745.851.652.0ui-event-bridge87.846.758.964.5network-bridge43.238.531.637.8logger-drain55.052.733.647.1discord-subscriptions57.223.638.939.9game-session63.159.955.759.6consumer-flow67.944.954.355.7chain-sync-poller44.853.538.345.6editor-commands78.443.962.961.8