wapi · DeepSeek V4 Pro run 3
28.1Library score
Pass rate69.3%
Simplicity53.0
Problems $$10.67
Library $$0.52
The library
wapi · designed by DeepSeek V4 Pro (mini-SWE)1,447 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE72.9%50.5$2.64
GLM 5.3 Flash · mini-SWE62.1%49.5$5.86
GPT-5.6 Luna · Codex73.3%59.7$2.18
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean
agent-runtime-protocol1.25.931.813.0reservation-receipts57.920.50.726.4page-publish-links1.45.717.98.3catalog-api28.825.613.922.8portal-routing43.321.855.740.2index-gateway54.348.555.252.7chain-index46.440.60.029.0chain-archive18.316.229.721.4project-routes33.05.139.826.0callback-registry44.324.456.841.8