umami · Opus 5.5 run 2

48.1Library score
Pass rate95.5%
Simplicity53.1
Problems $$7.02
Library $$8.89
The library
umami · designed by Opus 5.5 (mini-SWE)3,152 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE96.6%59.7$1.43
55.5
GLM 5.3 Flash · mini-SWE95.7%52.1$4.00
47.1
GPT-5.6 Luna · Codex94.3%47.4$1.59
41.8
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.