plaid · DeepSeek V4 Pro run 2
37.7Library score
Pass rate97.5%
Simplicity42.4
Problems $$11.60
Library $$0.59
The library
plaid · designed by DeepSeek V4 Pro (mini-SWE)2,178 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.9%42.0$3.91
GLM 5.3 Flash · mini-SWE97.9%46.8$5.25
GPT-5.6 Luna · Codex95.7%39.4$2.43
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
ledger-balance44.649.226.039.9typed-settings45.051.231.342.5keymap-resolver42.943.439.141.8template-trace40.640.633.238.1recipe-graph44.744.549.246.2scoped-eval47.00.042.829.9temporal-normalizer29.842.948.240.3script-recovery37.30.037.124.8stack-audit32.831.032.732.2query-resolution52.962.924.446.8selection-flattener38.349.738.042.0schema-resolver39.239.334.437.6grammar-crossref52.143.844.946.9config-digest37.70.027.121.6shape-atlas31.140.834.535.5