umami · GPT-6 Astra run 1

46.3Library score
Pass rate94.1%
Simplicity52.1
Problems $$5.98
Library $$3.11
The library
umami · designed by GPT-6 Astra (mini-SWE)1,103 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE93.7%59.1$1.73
52.8
GLM 5.3 Flash · mini-SWE94.9%52.3$2.62
46.0
GPT-5.6 Luna · Codex93.8%44.9$1.63
40.1
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.