umami · GPT-5.6 Sol run 1

48.5Library score
Pass rate96.1%
Simplicity52.4
Problems $$8.17
Library $$1.73
The library
umami · designed by GPT-5.6 Sol (Codex)921 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.6%57.3$2.31
55.3
GLM 5.3 Flash · mini-SWE96.7%50.9$4.11
46.9
GPT-5.6 Luna · Codex93.1%49.0$1.75
43.4
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.