umami · DeepSeek V4 Pro run 3

44.5Library score
Pass rate97.3%
Simplicity48.8
Problems $$7.26
Library $$0.16
The library
umami · designed by DeepSeek V4 Pro (mini-SWE)1,107 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.7%55.0$2.28
52.4
GLM 5.3 Flash · mini-SWE96.8%44.4$3.55
38.0
GPT-5.6 Luna · Codex96.4%46.8$1.44
43.2
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
db-notifications33.428.143.435.0log-worker-pool63.041.555.853.4backup-transfer24.028.724.925.9session-mailboxes40.635.232.436.1logger-shutdown34.831.130.332.1transport-ingress77.732.435.348.5server-output84.855.077.872.5packet-colors53.048.339.747.0client-routing60.20.033.631.3request-reservation60.640.138.546.4sync-progress45.343.338.242.3game-event-lanes52.443.053.949.8ui-event-bridge80.046.675.067.2network-bridge43.243.137.141.1logger-drain41.330.230.334.0discord-subscriptions40.134.740.638.5game-session58.351.743.751.3consumer-flow61.047.642.950.5chain-sync-poller33.637.845.038.8editor-commands60.542.246.049.5