wapi · Sonnet 5 run 1
12.3Run score
Pass rate29.4%
Simplicity64.1
Problems $$12.58
Sonnet 5 uses the real production library (servant).
ImplementerPass rateSimplicityCostScore
Sonnet 5 · mini-SWE29.4%64.1$12.58
ProblemSonnet 5
Click a problem to see how each solution's score is built.