umami · Fable 5.1 run 2

48.4Library score
Pass rate94.6%
Simplicity54.7
Problems $$9.68
Library $$11.85
The library
umami · designed by Fable 5.1 (mini-SWE)2,252 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.5%60.3$1.70
57.2
GLM 5.3 Flash · mini-SWE93.1%51.5$6.13
43.6
GPT-5.6 Luna · Codex92.2%52.1$1.84
44.5
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.