umami · GPT-5.6 Sol run 3

48.1Library score
Pass rate95.4%
Simplicity52.6
Problems $$8.81
Library $$1.45
The library
umami · designed by GPT-5.6 Sol (Codex)976 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.1%61.5$2.07
58.9
GLM 5.3 Flash · mini-SWE96.0%47.9$5.21
43.9
GPT-5.6 Luna · Codex92.0%48.4$1.54
41.5
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications60.332.238.543.7log-worker-pool56.637.645.246.5backup-transfer40.923.323.429.2session-mailboxes58.767.341.055.7logger-shutdown38.534.936.136.5transport-ingress60.649.837.249.2server-output82.571.575.676.5packet-colors57.949.34.237.1client-routing55.550.128.844.8request-reservation76.644.355.858.9sync-progress41.036.431.536.3game-event-lanes58.757.752.356.2ui-event-bridge75.852.344.657.5network-bridge43.035.739.639.4logger-drain34.539.437.537.1discord-subscriptions87.232.639.953.2game-session63.346.064.558.0consumer-flow67.828.428.541.6chain-sync-poller50.248.644.047.6editor-commands68.741.261.757.2