umami · GPT-6 Astra run 2

48.2Library score
Pass rate95.9%
Simplicity52.1
Problems $$5.70
Library $$2.95
The library
umami · designed by GPT-6 Astra (mini-SWE)926 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE94.7%56.3$1.74
51.3
GLM 5.3 Flash · mini-SWE97.7%50.4$2.47
48.1
GPT-5.6 Luna · Codex95.1%49.7$1.48
45.1
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.