npr · Sonnet 5 run 1
38.5Run score
Pass rate87.4%
Simplicity47.7
Problems $$6.61
Sonnet 5 uses the real production library (ndarray).
ImplementerPass rateSimplicityCostScore
Sonnet 5 · mini-SWE87.4%47.7$6.61
ProblemSonnet 5
Click a problem to see how each solution's score is built.