canon · Sonnet 5.5 run 2
68.2Run score
Pass rate92.9%
Simplicity75.2
Problems $$2.61
Sonnet 5.5 uses the real production library (pydantic).
ImplementerPass rateSimplicityCostScore
Sonnet 5.5 · mini-SWE92.9%75.2$2.61
ProblemSonnet 5.5
Click a problem to see how each solution's score is built.