wapi · Sonnet 5.5 run 1
57.6Run score
Pass rate71.2%
Simplicity97.4
Problems $$7.08
Sonnet 5.5 uses the real production library (servant).
ImplementerPass rateSimplicityCostScore
Sonnet 5.5 · mini-SWE71.2%97.4$7.08
ProblemSonnet 5.5
Click a problem to see how each solution's score is built.