–

rubberband · No library run 3

39.6Library score
Pass rate88.3%
Simplicity50.8
Problems $$6.36

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE91.3%48.5$1.20
41.6
GLM 5.3 Flash · mini-SWE86.7%51.7$4.09
34.7
GPT-5.6 Luna · Codex86.7%52.5$1.08
42.4
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
case-law-export24.927.923.725.5session-recall54.347.546.649.4document-finder31.025.932.129.7code-chunk-search26.121.731.226.3symbol-resolution64.247.434.048.5docs-search47.36.761.738.6knowledge-ingest71.381.263.872.1federated-search61.656.068.662.1post-indexer40.642.039.540.7blog-rebuild55.348.00.934.7mailbox-tags38.130.347.338.6attachment-explorer60.642.160.654.4archive-search40.232.953.142.1index-admin3.80.30.81.6file-locator63.385.975.374.9project-rule-search29.80.041.923.9blog-filters24.633.029.829.1dictionary-lookup27.637.027.530.7archive-timeline33.428.443.135.0source-rule-search34.90.066.733.8