wapi · Sonnet 5 run 3
15.3Run score
Pass rate34.3%
Simplicity63.3
Problems $$14.70
Sonnet 5 uses the real production library (servant).
ImplementerPass rateSimplicityCostScore
Sonnet 5 · mini-SWE34.3%63.3$14.70
ProblemSonnet 5
Click a problem to see how each solution's score is built.