simu · DeepSeek V4 Pro run 2
34.3Library score
Pass rate84.2%
Simplicity51.6
Problems $$4.75
Library $$0.39
The library
simu · designed by DeepSeek V4 Pro (mini-SWE)1,078 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE87.9%53.1$2.49
GLM 5.3 Flash · mini-SWE90.8%56.3$1.01
GPT-5.6 Luna · Codex76.6%47.3$1.25
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
intermodal-terminal-flow38.80.026.521.8diagnostic-specimen-release48.50.031.826.8rail-corridor-recovery71.078.157.168.7binary-offload-episode58.766.354.960.0packet-schedulers33.80.045.126.3wildfire-relief-depot32.80.09.314.0preempted-fault-race68.071.840.360.0rendezvous-rollback39.239.513.730.8filter-reservation30.834.224.529.9one-shot-bell44.546.543.444.8quorum-poisoned-losers48.439.040.342.5harbor-surge22.412.45.113.3harbor-vessels14.70.05.46.7