P

plaid · Production library run 1

37.8Library score
Pass rate91.1%
Simplicity49.0
Problems $$20.92

Implementers use the real production library (megaparsec).

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE99.1%48.9$2.94
48.0
GLM 5.3 Flash · mini-SWE86.6%51.8$15.22
29.0
GPT-5.6 Luna · Codex86.5%47.1$2.75
36.3
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
ledger-balance52.053.47.437.6typed-settings54.40.031.828.7keymap-resolver45.947.241.945.0template-trace46.743.527.339.1recipe-graph39.152.347.746.4scoped-eval49.60.035.828.5temporal-normalizer47.10.049.832.3script-recovery49.40.037.128.8stack-audit40.238.213.930.7query-resolution57.60.031.529.7selection-flattener50.952.047.150.0schema-resolver51.539.947.546.3grammar-crossref51.248.840.446.8config-digest43.217.636.132.3shape-atlas41.842.448.944.4