–

plaid · No library run 2

35.6Library score
Pass rate94.5%
Simplicity41.5
Problems $$9.01

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE98.4%40.9$1.41
39.6
GLM 5.3 Flash · mini-SWE93.3%43.6$5.47
33.2
GPT-5.6 Luna · Codex91.5%40.3$2.13
33.9
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.