umami · GPT-6 Sol run 3

47.6Library score
Pass rate95.9%
Simplicity52.0
Problems $$6.19
Library $$0.21
The library
umami · designed by GPT-6 Sol (mini-SWE)416 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.1%58.8$1.56
54.1
GLM 5.3 Flash · mini-SWE97.6%48.6$3.33
46.2
GPT-5.6 Luna · Codex92.9%48.7$1.30
42.6
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.