simu · Sonnet 5 run 3

33.4Run score
Pass rate69.1%
Simplicity57.8
Problems $$15.75

Sonnet 5 uses the real production library (simpy).

ImplementerPass rateSimplicityCostScore
Sonnet 5 · mini-SWE69.1%57.8$15.75
33.4
ProblemSonnet 5

Click a problem to see how each solution's score is built.