umami · Opus 5.5 run 3

48.8Library score
Pass rate94.2%
Simplicity54.8
Problems $$7.31
Library $$13.00
The library
umami · designed by Opus 5.5 (mini-SWE)3,227 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.0%58.7$1.57
55.9
GLM 5.3 Flash · mini-SWE90.4%53.2$4.07
42.9
GPT-5.6 Luna · Codex94.8%52.5$1.67
47.6
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.