umami · Sonnet 5 run 1
66.3Run score
Pass rate93.1%
Simplicity77.8
Problems $$10.69
Sonnet 5 uses the real production library (unagi-chan).
ImplementerPass rateSimplicityCostScore
Sonnet 5 · mini-SWE93.1%77.8$10.69
ProblemSonnet 5
Click a problem to see how each solution's score is built.