umami · Grok 4.6 run 3

46.0Library score
Pass rate93.6%
Simplicity51.3
Problems $$8.11
Library $$1.05
The library
umami · designed by Grok 4.6 (mini-SWE)2,075 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.0%58.8$2.48
55.8
GLM 5.3 Flash · mini-SWE92.1%46.1$4.25
40.6
GPT-5.6 Luna · Codex90.6%49.0$1.38
41.6
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.