P

clirs · Production library run 1

61.5Library score
Pass rate90.4%
Simplicity72.7
Problems $$5.92

Implementers use the real production library (clap).

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE96.3%71.2$1.57
65.3
GLM 5.3 Flash · mini-SWE86.6%74.4$2.58
56.6
GPT-5.6 Luna · Codex88.1%72.7$1.78
62.5
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.