umami · GPT-5.6 Sol run 2

47.5Library score
Pass rate95.2%
Simplicity52.5
Problems $$9.09
Library $$1.53
The library
umami · designed by GPT-5.6 Sol (Codex)1,315 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.6%57.9$2.00
55.6
GLM 5.3 Flash · mini-SWE97.1%50.0$5.34
46.6
GPT-5.6 Luna · Codex89.9%49.6$1.75
40.2
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.