heretical · DeepSeek V4 Pro run 3
28.5Library score
Pass rate87.2%
Simplicity37.5
Problems $$10.30
Library $$0.37
The library
heretical · designed by DeepSeek V4 Pro (mini-SWE)1,660 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE89.5%38.2$3.71
GLM 5.3 Flash · mini-SWE82.2%39.4$3.89
GPT-5.6 Luna · Codex89.7%35.0$2.70
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
note-import33.741.629.534.9techdocs-render30.438.421.930.2editor-import27.322.931.727.3attachment-paste27.132.636.732.1trusted-markdown14.60.022.112.2diagram-preview29.39.530.523.1matrix-message40.633.540.438.2notebook-output39.043.644.342.3email-render18.522.012.617.7svg-ingest18.922.318.419.9collection-render16.125.116.319.2api-docs22.119.516.819.4post-enrich29.727.325.527.5learning-outcome26.932.528.629.3package-panel25.230.924.126.7poll-export89.154.769.671.1reader-extract25.17.726.019.6article-extract35.924.037.432.4timeline-render45.840.232.439.5brand-svg23.00.024.415.8telegram-notify28.918.417.321.5story-markdown26.029.124.226.5