umami · Grok 4.6 run 1
47.4Library score
Pass rate94.2%
Simplicity53.7
Problems $$7.76
Library $$1.43
The library
umami · designed by Grok 4.6 (mini-SWE)2,541 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.0%57.8$2.54
GLM 5.3 Flash · mini-SWE96.9%53.9$3.63
GPT-5.6 Luna · Codex88.8%49.5$1.59
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
Click a problem to see how each solution's score is built.