umami · Sonnet 5.5 run 1
83.7Run score
Pass rate96.8%
Simplicity93.0
Problems $$2.29
Sonnet 5.5 uses the real production library (unagi-chan).
ImplementerPass rateSimplicityCostScore
Sonnet 5.5 · mini-SWE96.8%93.0$2.29
ProblemSonnet 5.5
Click a problem to see how each solution's score is built.