umami · GPT-6 Sol run 2

51.3Library score
Pass rate95.6%
Simplicity56.3
Problems $$7.52
Library $$0.19
The library
umami · designed by GPT-6 Sol (mini-SWE)449 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.9%62.5$1.70
58.6
GLM 5.3 Flash · mini-SWE94.0%54.2$4.39
48.3
GPT-5.6 Luna · Codex93.9%52.4$1.43
47.0
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications61.742.150.851.5log-worker-pool53.655.843.951.1backup-transfer39.315.722.725.9session-mailboxes55.781.342.359.8logger-shutdown26.644.030.833.8transport-ingress65.567.742.358.5server-output80.365.586.177.3packet-colors59.750.435.548.5client-routing59.737.237.644.8request-reservation51.047.744.647.8sync-progress53.434.943.744.0game-event-lanes82.445.461.763.2ui-event-bridge89.774.666.677.0network-bridge43.037.445.441.9logger-drain45.541.937.741.7discord-subscriptions73.750.055.259.7game-session49.365.363.859.5consumer-flow58.166.212.245.5chain-sync-poller46.93.346.832.3editor-commands76.739.869.962.1