umami · GPT-5.6 Sol run 3
48.1Library score
Pass rate95.4%
Simplicity52.6
Problems $$8.81
Library $$1.45
The library
umami · designed by GPT-5.6 Sol (Codex)976 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.1%61.5$2.07
GLM 5.3 Flash · mini-SWE96.0%47.9$5.21
GPT-5.6 Luna · Codex92.0%48.4$1.54
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
Click a problem to see how each solution's score is built.