canon · Sonnet 5 run 2

37.2Run score
Pass rate93.4%
Simplicity42.0
Problems $$8.50

Sonnet 5 uses the real production library (pydantic).

ImplementerPass rateSimplicityCostScore
Sonnet 5 · mini-SWE93.4%42.0$8.50
37.2
ProblemSonnet 5

Click a problem to see how each solution's score is built.