umami · Grok 4.6 run 2

46.0Library score
Pass rate95.1%
Simplicity50.9
Problems $$8.82
Library $$1.92
The library
umami · designed by Grok 4.6 (mini-SWE)2,402 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.4%59.0$2.39
54.5
GLM 5.3 Flash · mini-SWE92.4%47.0$4.70
41.2
GPT-5.6 Luna · Codex95.4%46.6$1.74
42.3
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.