–

uglypie · No library run 1

32.5Library score
Pass rate88.5%
Simplicity40.5
Problems $$2.63

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE92.4%39.5$0.77
34.4
GLM 5.3 Flash · mini-SWE83.6%43.2$1.08
31.1
GPT-5.6 Luna · Codex89.4%38.7$0.78
31.9
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
portal-ingest55.553.043.550.7kml-schema-import17.18.613.413.0news-crawl22.425.720.422.8access-tree22.125.227.825.1page-cleaner51.045.649.148.6exhibit-route21.422.523.422.5hearing-replay36.327.936.133.4festival-revisions38.526.028.831.1page-notes30.828.324.727.9genome-catalog56.055.854.955.6article-rewrite27.423.329.126.6