–

pyda · No library run 1

53.2Library score
Pass rate97.3%
Simplicity59.0
Problems $$4.24

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE99.7%62.6$1.02
57.2
GLM 5.3 Flash · mini-SWE93.5%60.4$2.45
51.5
GPT-5.6 Luna · Codex98.9%54.1$0.76
51.0
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
exposure-monitoring16.121.414.217.2taxonomy-match76.562.169.469.3ensemble-scores51.046.436.744.7device-pair-agreement59.79.450.439.8faers-signal-watch50.051.142.547.9sec-leverage-watch49.534.236.240.0county-crash-priority54.654.953.554.3storm-mitigation-priority63.912.560.845.7road-safety-priority57.159.954.257.1county-storm-burden48.953.831.844.8policy-anonymization52.855.249.652.5customer-merge39.945.340.041.7saccr-capital70.575.863.570.0scorer-lineage36.243.437.839.1overlapping-logs52.561.055.756.4weather-features60.442.463.655.5marine-heatwave76.796.374.582.5survival-risk62.271.458.063.8trade-imbalance64.260.359.161.2pattern-growth96.061.055.970.9planar-territories62.363.264.663.4