wapi · Sonnet 5.5 run 2
63.8Run score
Pass rate79.4%
Simplicity94.5
Problems $$7.74
Sonnet 5.5 uses the real production library (servant).
ImplementerPass rateSimplicityCostScore
Sonnet 5.5 · mini-SWE79.4%94.5$7.74
ProblemSonnet 5.5
Click a problem to see how each solution's score is built.