umami · GPT-6 Astra run 3

46.9Library score
Pass rate96.5%
Simplicity51.2
Problems $$7.45
Library $$3.42
The library
umami · designed by GPT-6 Astra (Codex)905 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.9%56.5$1.70
54.8
GLM 5.3 Flash · mini-SWE97.4%49.5$4.23
45.9
GPT-5.6 Luna · Codex93.1%47.6$1.52
39.9
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.