umami · Sonnet 5 run 3
65.8Run score
Pass rate94.6%
Simplicity73.9
Problems $$12.22
Sonnet 5 uses the real production library (unagi-chan).
ImplementerPass rateSimplicityCostScore
Sonnet 5 · mini-SWE94.6%73.9$12.22
ProblemSonnet 5
Click a problem to see how each solution's score is built.