umami · GLM 5.3 run 2

48.2Library score
Pass rate96.6%
Simplicity51.7
Problems $$8.50
Library $$38.86
The library
umami · designed by GLM 5.3 (mini-SWE)3,390 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.4%57.8$2.79
55.1
GLM 5.3 Flash · mini-SWE96.3%48.5$4.02
45.5
GPT-5.6 Luna · Codex95.0%48.8$1.68
44.0
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.