plaid · GPT-6 Astra run 1
44.5Library score
Pass rate94.1%
Simplicity51.1
Problems $$11.74
Library $$2.19
The library
plaid · designed by GPT-6 Astra (mini-SWE)798 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE97.2%47.5$2.86
GLM 5.3 Flash · mini-SWE86.3%58.0$6.29
GPT-5.6 Luna · Codex97.8%48.9$2.59
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
ledger-balance49.255.047.450.5typed-settings54.060.644.453.0keymap-resolver44.946.950.547.4template-trace46.60.047.131.2recipe-graph45.827.441.838.3scoped-eval51.70.049.133.6temporal-normalizer21.140.748.736.8script-recovery42.90.044.329.1stack-audit49.160.747.452.4query-resolution57.468.859.661.9selection-flattener56.065.351.457.6schema-resolver45.154.846.748.9grammar-crossref35.068.038.447.2config-digest47.845.434.142.4shape-atlas30.328.850.436.5