sapi · GPT-6 Astra run 1

35.4Library score
Pass rate95.3%
Simplicity39.8
Problems $$3.44
Library $$3.74
The library
sapi · designed by GPT-6 Astra (Codex)1,873 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE96.7%38.5$0.93
35.8
GLM 5.3 Flash · mini-SWE94.8%45.3$1.68
38.7
GPT-5.6 Luna · Codex94.3%35.6$0.83
31.8
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.