canon · Sonnet 5 run 1

43.1Run score
Pass rate96.5%
Simplicity46.0
Problems $$9.05

Sonnet 5 uses the real production library (pydantic).

ImplementerPass rateSimplicityCostScore
Sonnet 5 · mini-SWE96.5%46.0$9.05
43.1
ProblemSonnet 5

Click a problem to see how each solution's score is built.