wapi · Sonnet 5 run 3

15.3Run score
Pass rate34.3%
Simplicity63.3
Problems $$14.70

Sonnet 5 uses the real production library (servant).

ImplementerPass rateSimplicityCostScore
Sonnet 5 · mini-SWE34.3%63.3$14.70
15.3
ProblemSonnet 5

Click a problem to see how each solution's score is built.