umami · GPT-6 Sol run 3
47.6Library score
Pass rate95.9%
Simplicity52.0
Problems $$6.19
Library $$0.21
The library
umami · designed by GPT-6 Sol (mini-SWE)416 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.1%58.8$1.56
GLM 5.3 Flash · mini-SWE97.6%48.6$3.33
GPT-5.6 Luna · Codex92.9%48.7$1.30
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications62.933.232.843.0log-worker-pool58.157.335.250.2backup-transfer32.417.835.628.6session-mailboxes43.565.335.848.2logger-shutdown39.031.235.935.4transport-ingress52.769.037.353.0server-output85.464.758.269.4packet-colors65.460.43.843.2client-routing52.341.547.647.2request-reservation48.337.246.944.2sync-progress38.140.744.141.0game-event-lanes59.252.165.058.7ui-event-bridge78.568.861.669.6network-bridge49.531.241.140.6logger-drain36.931.128.132.0discord-subscriptions70.237.850.852.9game-session48.135.050.644.6consumer-flow53.867.558.059.7chain-sync-poller45.934.739.940.2editor-commands61.548.343.451.1