simu · Sonnet 5.5 run 1
54.9Run score
Pass rate84.5%
Simplicity77.6
Problems $$3.44
Sonnet 5.5 uses the real production library (simpy).
ImplementerPass rateSimplicityCostScore
Sonnet 5.5 · mini-SWE84.5%77.6$3.44
ProblemSonnet 5.5
Click a problem to see how each solution's score is built.