umami · GPT-6 Astra run 2

46.2Library score
Pass rate95.9%
Simplicity50.8
Problems $$8.10
Library $$3.45
The library
umami · designed by GPT-6 Astra (Codex)967 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.3%56.8$1.69
54.7
GLM 5.3 Flash · mini-SWE93.8%48.7$4.87
42.1
GPT-5.6 Luna · Codex95.5%46.9$1.54
41.9
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.