P

clirs · Production library run 3

60.5Library score
Pass rate89.4%
Simplicity73.3
Problems $$6.41

Implementers use the real production library (clap).

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE95.0%74.0$1.66
65.4
GLM 5.3 Flash · mini-SWE78.1%73.8$2.87
50.3
GPT-5.6 Luna · Codex95.1%72.3$1.88
65.8
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.