P

weft · Production library run 3

32.9Library score
Pass rate67.5%
Simplicity56.4
Problems $$17.09

Implementers use the real production library (chumsky).

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE48.0%52.1$1.58
24.2
GLM 5.3 Flash · mini-SWE77.0%57.1$12.42
34.2
GPT-5.6 Luna · Codex77.4%59.9$3.10
40.3
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
bag-rules0.024.337.520.6ninja-build31.837.69.626.3mail-addresses1.141.944.629.2property-paths0.130.941.024.0formula-ledger41.825.432.033.0record-spans88.864.495.182.8block-events52.762.458.357.8command-errors0.029.110.813.3route-tags40.17.139.528.9template-audit0.036.370.635.7grammar-inventory27.629.813.923.8grammar-trace54.612.462.643.2nesting-guard0.041.714.418.7unicode-spans0.036.234.823.7