heretical · Grok 4.6 run 1

32.4Library score
Pass rate82.9%
Simplicity45.3
Problems $$17.79
Library $$2.58
The library
heretical · designed by Grok 4.6 (mini-SWE)4,040 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE86.9%45.1$6.64
34.7
GLM 5.3 Flash · mini-SWE76.1%47.6$7.84
30.2
GPT-5.6 Luna · Codex85.8%43.2$3.31
32.4
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
note-import43.654.242.546.8techdocs-render39.530.844.438.2editor-import39.815.624.326.5attachment-paste40.837.035.037.6trusted-markdown22.419.522.121.3diagram-preview35.10.046.927.3matrix-message41.537.553.244.0notebook-output40.938.440.339.9email-render9.20.013.87.6svg-ingest28.729.421.026.4collection-render28.427.422.326.1api-docs33.924.633.930.8post-enrich11.312.727.617.2learning-outcome30.535.519.728.6package-panel42.941.528.737.7poll-export74.063.874.070.6reader-extract46.942.525.338.2article-extract27.922.239.129.7timeline-render35.142.832.136.7brand-svg23.924.531.026.5telegram-notify22.118.718.019.6story-markdown44.346.418.636.4