npr · Sonnet 5.5 run 3
62.9Run score
Pass rate93.3%
Simplicity71.1
Problems $$2.03
Sonnet 5.5 uses the real production library (ndarray).
ImplementerPass rateSimplicityCostScore
Sonnet 5.5 · mini-SWE93.3%71.1$2.03
ProblemSonnet 5.5
Click a problem to see how each solution's score is built.