clirs · GPT-6 Astra run 1
59.2Library score
Pass rate91.1%
Simplicity71.8
Problems $$3.71
Library $$3.80
The library
clirs · designed by GPT-6 Astra (mini-SWE)3,051 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE93.8%68.1$1.16
GLM 5.3 Flash · mini-SWE83.6%77.8$1.34
GPT-5.6 Luna · Codex95.8%69.6$1.21
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
maintainer-tools54.559.853.756.0turbo-query43.446.259.649.8onboard59.180.471.470.3chain-exec80.30.782.154.4subcommand-groups67.461.570.266.4pointer-indexer41.635.836.838.1site-builder52.154.561.456.0launcher-plan43.247.154.148.2process-inspect80.975.479.978.7relay-compiler78.558.451.062.6cross-build20.225.742.929.6backup-variants73.980.277.677.2devctl-families76.990.379.582.2