P

uglypie · Production library run 1

56.1Library score
Pass rate91.9%
Simplicity65.4
Problems $$5.04

Implementers use the real production library (beautifulsoup4).

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE94.5%67.9$0.89
61.1
GLM 5.3 Flash · mini-SWE89.2%67.5$3.04
55.4
GPT-5.6 Luna · Codex92.0%60.8$1.11
51.9
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
portal-ingest68.760.848.859.4kml-schema-import67.422.126.938.8news-crawl36.127.144.836.0access-tree57.455.162.158.2page-cleaner51.454.056.453.9exhibit-route43.040.540.141.2hearing-replay73.278.667.373.1festival-revisions58.348.050.552.3page-notes67.364.545.359.0genome-catalog54.966.463.061.5article-rewrite93.891.865.983.8