umami · GPT-6 Sol run 1

48.6Library score
Pass rate97.6%
Simplicity51.4
Problems $$7.22
Library $$0.20
The library
umami · designed by GPT-6 Sol (mini-SWE)431 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.5%56.6$1.85
54.0
GLM 5.3 Flash · mini-SWE98.8%51.2$4.04
49.9
GPT-5.6 Luna · Codex95.7%46.2$1.32
41.9
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.