plaid · DeepSeek V4 Pro run 1

31.4Library score
Pass rate94.0%
Simplicity41.0
Problems $$11.11
Library $$0.68
The library
plaid · designed by DeepSeek V4 Pro (mini-SWE)1,978 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.8%41.3$4.00
40.4
GLM 5.3 Flash · mini-SWE95.3%44.4$4.56
21.5
GPT-5.6 Luna · Codex88.6%38.9$2.55
32.4
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
ledger-balance41.926.60.122.9typed-settings45.60.028.124.6keymap-resolver34.530.029.531.3template-trace41.30.037.826.4recipe-graph41.50.043.628.4scoped-eval43.50.037.927.1temporal-normalizer32.238.839.636.9script-recovery37.70.032.323.4stack-audit36.60.036.124.2query-resolution58.149.850.052.6selection-flattener41.439.930.637.3schema-resolver36.40.029.321.9grammar-crossref51.560.230.147.3config-digest27.338.229.931.8shape-atlas35.839.331.535.5