P
uglypie · Production library run 1
56.1Library score
Pass rate91.9%
Simplicity65.4
Problems $$5.04
Implementers use the real production library (beautifulsoup4).
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE94.5%67.9$0.89
GLM 5.3 Flash · mini-SWE89.2%67.5$3.04
GPT-5.6 Luna · Codex92.0%60.8$1.11
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
Click a problem to see how each solution's score is built.