Astra's 99.9% Score Came From the Harness, Not the Model
OpenAI's ARC-AGI-3 results sheet lists 62.7% and 99.9% side by side for the same model. Tracing why one model ends up with two scores reveals who actually deserves credit for this result.
350
AWS
Amazon's cloud platform. It rents out servers that AI companies use to run their models, and sells models from multiple companies through Bedrock. Its flagship services include EC2, the computing infrastructure, and Bedrock, the AI model service. In the case of the Astra model, which drew attention in a September 2026 benchmark, some assessments suggested that the deciding factor in performance was not the model itself but the harness surrounding it—that is, its execution environment.
Current rank (1M)
66
- Change
- Prev.
- –
Rank over the last 6 days
2026.09.08 – 2026.09.13 · High 65 · Low 74 · Now 66
AWS · Related stories
DuckLabs joins AWS, keeps DuckDB open source
DuckLabs, which spent five years without venture funding, is joining AWS in early September, and DuckDB stays under its MIT license
30
AI Agent 'Skills': Procedure, Not Knowledge, Drives Performance
Princeton and UC San Diego researchers ran 8,135 experiments to uncover what actually makes skills work — and where they fall short
10
MCP's New Roadmap Enables Stateless, Horizontally Scalable Servers
MCP, the standard for connecting AI tools, has revised its roadmap just five months after the last one. Servers no longer need to hold onto state, and agent identity authentication is up next.
50
That's the last story.
AWS · Recent announcements
- –Amazon EC2 R9g and R9gd instances powered by AWS Graviton5 processors are now generally available
- –AWS Weekly Roundup: Welcome DuckLabs to the team, Agentic Resource Discovery (ARD), and more (August 31, 2026)
- –Happy 20th Birthday, Amazon EC2
- –AWS Weekly Roundup: Student Rewards on AWS Builder Center, Local Zone in Las Vegas, and more (August 24, 2026)