umami · Sonnet 5 run 2
62.4Run score
Pass rate88.8%
Simplicity77.1
Problems $$9.86
Sonnet 5 uses the real production library (unagi-chan).
ImplementerPass rateSimplicityCostScore
Sonnet 5 · mini-SWE88.8%77.1$9.86
ProblemSonnet 5
Click a problem to see how each solution's score is built.