umami · Sonnet 5.5 run 2
83.3Run score
Pass rate97.3%
Simplicity92.7
Problems $$2.27
Sonnet 5.5 uses the real production library (unagi-chan).
ImplementerPass rateSimplicityCostScore
Sonnet 5.5 · mini-SWE97.3%92.7$2.27
ProblemSonnet 5.5
Click a problem to see how each solution's score is built.