P
plaid · Production library run 2
39.8Library score
Pass rate96.2%
Simplicity49.0
Problems $$17.79
Implementers use the real production library (megaparsec).
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.8%49.4$2.58
GLM 5.3 Flash · mini-SWE91.5%51.1$12.46
GPT-5.6 Luna · Codex96.3%47.2$2.75
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
ledger-balance49.47.544.433.7typed-settings49.50.026.225.2keymap-resolver52.744.842.246.6template-trace44.50.041.828.8recipe-graph51.10.051.234.1scoped-eval46.60.051.032.6temporal-normalizer38.441.946.642.3script-recovery53.754.443.250.4stack-audit43.741.840.241.9query-resolution56.271.855.761.3selection-flattener47.70.048.532.0schema-resolver47.749.144.147.0grammar-crossref51.70.048.333.3config-digest47.146.734.342.7shape-atlas44.747.142.244.6