umami · Sonnet 5.5 run 3
79.2Run score
Pass rate95.6%
Simplicity90.6
Problems $$2.18
Sonnet 5.5 uses the real production library (unagi-chan).
ImplementerPass rateSimplicityCostScore
Sonnet 5.5 · mini-SWE95.6%90.6$2.18
ProblemSonnet 5.5
Click a problem to see how each solution's score is built.