umami · Fable 5.1 run 1

48.1Library score
Pass rate93.0%
Simplicity55.0
Problems $$9.95
Library $$14.30
The library
umami · designed by Fable 5.1 (mini-SWE)3,142 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE93.1%58.6$1.99
52.4
GLM 5.3 Flash · mini-SWE92.9%56.7$6.14
48.2
GPT-5.6 Luna · Codex93.1%49.6$1.82
43.6
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.