P

clirs · Production library run 1

61.5Library score
Pass rate90.4%
Simplicity72.7
Problems $$5.92

Implementers use the real production library (clap).

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE96.3%71.2$1.57
65.3
GLM 5.3 Flash · mini-SWE86.6%74.4$2.58
56.6
GPT-5.6 Luna · Codex88.1%72.7$1.78
62.5
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
maintainer-tools56.555.767.559.9turbo-query71.959.856.562.7onboard63.959.363.862.3chain-exec74.483.695.684.5subcommand-groups59.386.963.269.8pointer-indexer35.158.40.031.2site-builder63.30.089.050.8launcher-plan81.666.069.872.5process-inspect56.955.140.050.7relay-compiler54.244.861.953.6cross-build66.30.040.835.7backup-variants72.581.176.676.7devctl-families93.784.887.588.6