P

clirs · Production library run 3

60.5Library score
Pass rate89.4%
Simplicity73.3
Problems $$6.41

Implementers use the real production library (clap).

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE95.0%74.0$1.66
65.4
GLM 5.3 Flash · mini-SWE78.1%73.8$2.87
50.3
GPT-5.6 Luna · Codex95.1%72.3$1.88
65.8
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
maintainer-tools65.357.471.664.8turbo-query52.128.561.547.4onboard63.766.862.864.4chain-exec67.569.076.471.0subcommand-groups61.465.167.764.7pointer-indexer33.144.534.337.3site-builder86.00.074.953.6launcher-plan79.472.287.579.7process-inspect55.343.671.856.9relay-compiler78.047.640.955.5cross-build55.564.122.747.4backup-variants83.294.888.388.8devctl-families69.50.095.555.0