P

plaid · Production library run 3

43.1Library score
Pass rate96.4%
Simplicity49.3
Problems $$20.83

Implementers use the real production library (megaparsec).

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE99.1%49.1$2.55
48.3
GLM 5.3 Flash · mini-SWE99.0%50.0$15.56
39.3
GPT-5.6 Luna · Codex91.7%48.9$2.72
41.7
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
ledger-balance51.60.015.522.4typed-settings57.446.940.548.3keymap-resolver46.936.841.441.7template-trace42.139.246.942.7recipe-graph53.748.921.341.3scoped-eval53.60.044.932.8temporal-normalizer41.549.452.547.8script-recovery45.060.930.445.4stack-audit41.345.048.745.0query-resolution59.461.358.159.6selection-flattener53.144.354.450.6schema-resolver48.144.440.644.4grammar-crossref48.449.748.848.9config-digest43.60.038.727.5shape-atlas38.162.542.947.8