–

rubberband · No library run 2

42.4Library score
Pass rate92.2%
Simplicity48.6
Problems $$5.77

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE90.2%48.7$0.94
41.8
GLM 5.3 Flash · mini-SWE96.3%45.4$3.71
41.0
GPT-5.6 Luna · Codex90.2%51.8$1.13
44.4
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
case-law-export28.423.226.326.0session-recall50.524.645.140.1document-finder29.645.90.025.2code-chunk-search28.329.220.826.1symbol-resolution24.444.635.134.7docs-search52.845.649.149.2knowledge-ingest72.073.754.266.6federated-search75.063.774.671.1post-indexer41.349.148.546.3blog-rebuild47.053.556.752.4mailbox-tags34.935.446.739.0attachment-explorer62.039.054.051.7archive-search53.339.253.148.5index-admin0.517.328.315.4file-locator62.564.178.568.4project-rule-search27.036.740.934.9blog-filters33.133.452.439.6dictionary-lookup29.126.424.726.8archive-timeline29.734.339.734.5source-rule-search54.442.058.651.6