umami · GPT-6 Sol run 2

51.3Library score
Pass rate95.6%
Simplicity56.3
Problems $$7.52
Library $$0.19
The library
umami · designed by GPT-6 Sol (mini-SWE)449 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.9%62.5$1.70
58.6
GLM 5.3 Flash · mini-SWE94.0%54.2$4.39
48.3
GPT-5.6 Luna · Codex93.9%52.4$1.43
47.0
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.