–

pyda · No library run 3

50.1Library score
Pass rate94.4%
Simplicity58.5
Problems $$4.11

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE95.7%61.6$1.00
54.2
GLM 5.3 Flash · mini-SWE88.7%60.0$2.45
44.9
GPT-5.6 Luna · Codex98.8%53.9$0.65
51.1
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
exposure-monitoring16.114.323.217.9taxonomy-match75.070.952.866.2ensemble-scores43.150.335.042.8device-pair-agreement57.842.153.251.0faers-signal-watch1.956.546.735.0sec-leverage-watch41.839.235.338.7county-crash-priority55.257.151.354.5storm-mitigation-priority65.213.062.947.0road-safety-priority61.453.156.857.1county-storm-burden53.552.135.246.9policy-anonymization44.849.840.845.1customer-merge38.140.237.838.7saccr-capital75.362.161.066.1scorer-lineage36.441.739.939.3overlapping-logs53.960.050.654.8weather-features52.741.760.351.6marine-heatwave95.80.284.360.1survival-risk61.853.961.258.9trade-imbalance63.720.759.748.0pattern-growth81.260.860.967.6planar-territories63.463.964.263.8