canon · Sonnet 5.5 run 1
70.4Run score
Pass rate98.7%
Simplicity72.4
Problems $$2.65
Sonnet 5.5 uses the real production library (pydantic).
ImplementerPass rateSimplicityCostScore
Sonnet 5.5 · mini-SWE98.7%72.4$2.65
ProblemSonnet 5.5
Click a problem to see how each solution's score is built.