canon · Sonnet 5 run 3
43.5Run score
Pass rate95.3%
Simplicity46.7
Problems $$8.56
Sonnet 5 uses the real production library (pydantic).
ImplementerPass rateSimplicityCostScore
Sonnet 5 · mini-SWE95.3%46.7$8.56
ProblemSonnet 5
Click a problem to see how each solution's score is built.