umami · GPT-6 Astra run 1

47.1Library score
Pass rate95.4%
Simplicity51.9
Problems $$9.26
Library $$4.10
The library
umami · designed by GPT-6 Astra (Codex)894 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.6%56.7$1.65
53.1
GLM 5.3 Flash · mini-SWE92.7%48.4$6.10
41.3
GPT-5.6 Luna · Codex95.9%50.6$1.51
47.0
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.