heretical · GPT-5.6 Sol run 3

36.8Library score
Pass rate82.1%
Simplicity51.3
Problems $$13.01
Library $$2.05
The library
heretical · designed by GPT-5.6 Sol (Codex)775 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE88.7%53.9$3.05
42.9
GLM 5.3 Flash · mini-SWE69.8%52.8$7.40
30.8
GPT-5.6 Luna · Codex87.9%47.1$2.56
36.8
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.