simu · Sonnet 5.5 run 2
53.0Run score
Pass rate89.3%
Simplicity73.6
Problems $$3.53
Sonnet 5.5 uses the real production library (simpy).
ImplementerPass rateSimplicityCostScore
Sonnet 5.5 · mini-SWE89.3%73.6$3.53
ProblemSonnet 5.5
Click a problem to see how each solution's score is built.