canon · Sonnet 5.5 run 3
69.8Run score
Pass rate99.8%
Simplicity70.9
Problems $$2.77
Sonnet 5.5 uses the real production library (pydantic).
ImplementerPass rateSimplicityCostScore
Sonnet 5.5 · mini-SWE99.8%70.9$2.77
ProblemSonnet 5.5
Click a problem to see how each solution's score is built.