–

pyda · No library run 2

50.5Library score
Pass rate94.2%
Simplicity60.5
Problems $$4.36

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE93.9%62.9$1.04
54.6
GLM 5.3 Flash · mini-SWE90.4%64.8$2.73
47.1
GPT-5.6 Luna · Codex98.1%54.1$0.58
49.9
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
exposure-monitoring5.20.020.58.6taxonomy-match81.950.960.964.6ensemble-scores50.943.935.943.6device-pair-agreement63.140.446.950.1faers-signal-watch5.657.646.336.5sec-leverage-watch38.246.936.340.5county-crash-priority56.439.549.048.3storm-mitigation-priority62.213.156.744.0road-safety-priority59.263.156.459.6county-storm-burden58.039.631.142.9policy-anonymization52.344.447.047.9customer-merge43.243.637.141.3saccr-capital73.669.164.168.9scorer-lineage40.639.233.937.9overlapping-logs62.258.145.355.2weather-features38.456.056.550.3marine-heatwave91.379.480.783.8survival-risk68.259.961.863.3trade-imbalance61.921.860.648.1pattern-growth67.670.358.165.4planar-territories66.052.562.260.2