P

clirs · Production library run 2

64.9Library score
Pass rate94.2%
Simplicity73.4
Problems $$5.61

Implementers use the real production library (clap).

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE95.2%74.3$1.48
66.6
GLM 5.3 Flash · mini-SWE92.3%73.3$2.40
63.3
GPT-5.6 Luna · Codex94.9%72.7$1.72
64.7
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
maintainer-tools57.830.167.651.9turbo-query86.233.458.659.4onboard65.664.366.565.5chain-exec20.385.286.063.8subcommand-groups81.487.295.388.0pointer-indexer35.335.732.634.5site-builder83.480.269.977.8launcher-plan62.754.964.360.6process-inspect65.554.264.561.4relay-compiler79.561.942.561.3cross-build54.763.555.557.9backup-variants81.685.569.478.8devctl-families91.287.268.182.2