npr · Grok 4.6 run 1
48.9Library score
Pass rate88.5%
Simplicity58.9
Problems $$8.86
Library $$2.39
The library
npr · designed by Grok 4.6 (mini-SWE)6,806 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE93.4%59.2$2.31
GLM 5.3 Flash · mini-SWE82.5%57.2$4.95
GPT-5.6 Luna · Codex89.5%60.3$1.60
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
cluster-consensus27.128.335.430.3logistic-path98.055.596.383.3relu-regions20.610.025.618.7table-reasoning97.037.471.468.6embedding-pooling51.050.058.153.0kv-cache61.051.751.754.8channel-stft46.654.548.049.7irls-path64.558.249.857.5peak-covariance21.140.919.627.2envelope-curvature36.98.850.632.1radiance-moments67.645.257.856.9kalman-update55.383.668.769.2csi-pose57.40.00.019.1vmc-update43.70.20.114.7pose-correction67.783.159.270.0spectral-reconstruction29.753.184.155.6portfolio-risk85.373.764.574.5contact-forces37.462.957.252.5density-propagation31.37.854.231.1tensor-train1.479.997.459.5