umami · GPT-6 Astra run 3

46.1Library score
Pass rate93.8%
Simplicity52.0
Problems $$6.46
Library $$2.52
The library
umami · designed by GPT-6 Astra (mini-SWE)772 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE94.4%59.3$1.73
53.5
GLM 5.3 Flash · mini-SWE91.6%49.8$3.08
42.6
GPT-5.6 Luna · Codex95.3%47.0$1.65
42.3
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.