heretical · DeepSeek V4 Pro run 1

33.7Library score
Pass rate89.0%
Simplicity42.3
Problems $$10.66
Library $$0.26
The library
heretical · designed by DeepSeek V4 Pro (mini-SWE)1,977 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE90.5%39.9$4.39
33.0
GLM 5.3 Flash · mini-SWE88.4%48.5$3.70
37.5
GPT-5.6 Luna · Codex88.1%38.6$2.58
30.6
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
note-import35.558.837.944.1techdocs-render29.255.626.537.1editor-import21.843.826.630.7attachment-paste23.835.442.934.0trusted-markdown31.421.824.125.8diagram-preview44.831.019.531.8matrix-message48.445.445.646.5notebook-output32.644.741.339.5email-render25.223.59.819.5svg-ingest19.624.616.620.3collection-render21.462.520.634.8api-docs24.220.021.021.7post-enrich43.29.937.830.3learning-outcome26.455.736.939.7package-panel34.940.523.933.1poll-export87.071.988.982.6reader-extract39.637.226.234.3article-extract35.325.033.331.2timeline-render30.232.532.631.8brand-svg13.226.721.220.4telegram-notify30.230.817.626.2story-markdown28.927.623.426.6