–

simu · No library run 2

38.6Library score
Pass rate85.4%
Simplicity55.0
Problems $$2.68

Implementers get no library and write everything from scratch.

ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE85.1%55.0$1.01
42.0
GLM 5.3 Flash · mini-SWE89.8%59.9$0.89
36.8
GPT-5.6 Luna · Codex82.3%51.1$0.77
36.9
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
intermodal-terminal-flow30.627.134.430.7diagnostic-specimen-release41.149.635.942.2rail-corridor-recovery58.170.655.961.5binary-offload-episode62.664.854.560.6packet-schedulers34.60.046.727.1wildfire-relief-depot16.10.07.47.8preempted-fault-race52.952.141.848.9rendezvous-rollback77.638.321.445.8filter-reservation39.937.947.141.6one-shot-bell64.853.655.958.1quorum-poisoned-losers37.649.843.543.6harbor-surge19.634.87.420.6harbor-vessels10.80.028.012.9