–

rubberband · No library run 1

40.5Library score
Pass rate89.9%
Simplicity48.3
Problems $$6.03

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE95.0%46.5$1.00
42.1
GLM 5.3 Flash · mini-SWE84.3%46.9$4.03
35.3
GPT-5.6 Luna · Codex90.4%51.6$1.00
44.2
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
case-law-export29.325.324.926.5session-recall49.835.543.342.9document-finder32.828.834.732.1code-chunk-search25.830.919.025.2symbol-resolution21.969.736.942.9docs-search53.09.350.037.4knowledge-ingest68.477.555.667.2federated-search59.33.861.841.6post-indexer51.234.240.842.1blog-rebuild57.152.049.552.9mailbox-tags41.036.845.141.0attachment-explorer49.846.961.352.7archive-search44.529.452.542.1index-admin29.821.50.717.4file-locator77.263.281.774.0project-rule-search27.625.548.433.8blog-filters25.10.036.220.5dictionary-lookup25.225.027.525.9archive-timeline31.932.341.835.3source-rule-search40.557.872.456.9