umami · Fable 5.1 run 3
50.7Library score
Pass rate94.3%
Simplicity56.8
Problems $$8.03
Library $$19.46
The library
umami · designed by Fable 5.1 (mini-SWE)2,710 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.7%65.6$1.36
GLM 5.3 Flash · mini-SWE93.7%55.1$4.82
GPT-5.6 Luna · Codex91.6%49.8$1.85
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
Click a problem to see how each solution's score is built.