sapi · GPT-6 Astra run 3

43.0Library score
Pass rate95.1%
Simplicity47.4
Problems $$3.26
Library $$3.93
The library
sapi · designed by GPT-6 Astra (Codex)1,935 source lines
ImplementerPass rateSimplicityCostScore
DeepSeek V4.1 Flash · mini-SWE95.9%47.9$0.80
44.3
GLM 5.3 Flash · mini-SWE94.7%45.6$1.62
41.1
GPT-5.6 Luna · Codex94.7%48.8$0.84
43.6
ProblemDeepSeek V4.1 FlashGLM 5.3 FlashGPT-5.6 LunaMean

Click a problem to see how each solution's score is built.