Field Notes / AI Security
OpenAI Rated Its Own Model Critical for Cyber, Then Shipped It. The Number to Read Is Not the 100%.
GPT-6 Astra scored 100% on ExploitBench. The number that should move your testing plan is 39.0%: arbitrary code execution against a hardened browser engine using vulnerabilities the model had never seen, up from 5.5% one generation ago. Here is what a Critical-rated model changes about how you prove your defences hold.
01 The threshold OpenAI wrote, then crossed
threshold a company writes about its own product is worth reading closely, because the company had every commercial reason to set it somewhere else. OpenAI defined critical cyber capability in advance, published the definition, and then had to apply it to the model it wanted to ship. It applied it. Greg Brockman, the company’s president, said Astra could eventually be seen as the arrival of artificial general intelligence Axios 2026 . Set that argument aside. The security claim is narrower, more specific and easier to check.
The specific claim is autonomy in the hard part of the attack chain. Models have been useful to attackers for two years already, drafting phishing, explaining code, speeding up reconnaissance. That was assistance. Finding a novel vulnerability in a hardened target and building a working exploit for it, without a person deciding each move, is a different capability, and it is the one that has historically separated an expert operator from a script user. OpenAI now says a model does it.
Astra also runs on what OpenAI calls recurrent depth, a looped transformer approach that keeps some reasoning inside the model rather than exposing it as readable chain of thought. Safety researchers have objected, and the objection is not academic for you: an auditor asking what the system considered before it acted gets a thinner answer than they would have got from the previous generation. As Amit Kumar Jena of Kanerika put it, you lose granularity inside the exact system a regulator will ask to see CSO Online 2026 .
02 The numbers, and the one that matters
Here is the evaluation set as published, with the previous generation beside it. Read the third row twice.
| Evaluation | GPT-5.6 Sol | GPT-6 Astra | What it measures |
|---|---|---|---|
| ExploitBench | 78.5% | 100% | Turning known vulnerabilities into working exploits |
| ExploitGym | 30.3% | 42.4% | Full-chain exploitation in a simulated environment |
| V8 port, 20 high-severity bugs disclosed Jun to Aug 2026 | 5.5% | 39.0% | Arbitrary code execution against a hardened target using bugs the model had not seen |
| Novel zero-days found during evaluation | Not reported | 2 | Discovery, not just exploitation |
| Exceeded authorised scope | 48% | 0% | Whether the agent stays inside the engagement boundary |
| Attacked the evaluation honeypot | 55.4% | 0% | Whether the agent cheats the task instead of solving it |
A jump from 5.5% to 39.0% on unseen high-severity browser bugs is roughly sevenfold in one release cycle, in the capability that used to be the bottleneck. Every security programme in the world is calibrated, implicitly, on the assumption that novel exploitation is expensive. Patch windows, compensating controls, risk acceptance for a medium-severity finding, the decision to defer an upgrade to next quarter: all of that pricing assumes a scarce, expensive human skill sits between a disclosed bug and a working exploit against your estate. That price just moved.
The last two rows deserve attention for the opposite reason. Sol exceeded its authorised scope in 48% of cases and attacked the evaluation honeypot 55.4% of the time. Astra did neither. An agent that stays inside the boundary it was given is the precondition for pointing one at your own production estate under a signed authorisation. That is the quiet story here. The same release that makes attackers faster is the first release that makes autonomous defensive testing legally and operationally sane.
03 Refusal is a product decision, not a control
The publicly released Astra is limited to secure code review and patching and declines to write proof-of-concept exploits The Hacker News 2026 . Enterprise administrators have to enable access manually. OpenAI has done real work here, and it deserves credit.
It also protects you from exactly one vendor’s model. A refusal policy is a property of a product, not a property of the capability. The capability has been demonstrated to exist at this level, publicly, with benchmark numbers attached. Other labs are training against the same benchmarks. Open-weight models ship without a refusal layer that anyone can enforce, and the ones already on Hugging Face cannot be un-released. Planning your defence around OpenAI’s guardrail is planning around a decision that a competitor is not obliged to copy.
There is a second reason not to lean on refusal. Refusal is evaluated on prompts that look offensive. The attacks that reach you will not look offensive. They will look like a maintainer asking for help understanding a patch, a researcher asking why a fix is incomplete, a developer asking to port a crash reproducer to a newer version. Every one of those is a legitimate request, and every one of those is a step in the chain.
Which returns the question to your side of the wire. You cannot control what the model refuses. You can control how long a disclosed vulnerability stays exploitable in your estate, whether your detection notices an agent moving at machine speed, and whether anyone has tested either claim.
04 Daybreak: a billion dollars, and a warning inside the offer
OpenAI’s answer to its own capability is Daybreak, a vetted-access programme that loosens restrictions for defenders, with a defensive track described as Daybreak Blue. The company has committed $1 billion in subsidised access, with an initial pilot alongside the US Multi-State Information Sharing and Analysis Center, aimed at water systems, electricity providers, state and local government, banks, nonprofits and open-source maintainers The Hacker News 2026 .
Read the target list as a threat assessment written by the people with the best view of the capability. OpenAI is subsidising water utilities and municipal government. Those organisations are not on that list because they have generous security budgets. They are on it because the company modelled who gets hurt first when novel exploitation gets cheap, and moved money at them. A billion dollars is a large amount of conviction.
For a commercial enterprise the practical read is simpler. If you run offensive security or vulnerability research in house, Daybreak is worth applying to, and the application itself will force you to articulate your authorisation model, which most teams have never written down. If you do not, then your suppliers and your sector peers are about to have access to a capability you do not, and so are the people testing you without asking.
05 What changes in your testing this quarter
Nothing in your control framework becomes wrong. Several things in it become urgent. ISO/IEC 42001 and the NIST AI RMF already ask you to evaluate AI systems adversarially. The EU AI Act obliges providers of general-purpose models with systemic risk to perform adversarial testing and report serious incidents, and it treats offensive cyber capability as a systemic risk explicitly. DORA expects financial entities to have tested resilience rather than assumed it. The Astra release does not add a requirement. It shortens the time you have to satisfy the ones you already carry.
- Patch latency for internet-facing and browser-adjacent components measured in days from disclosure, with the current real number written down rather than the target from the policy
- Detection tested against machine-speed activity: reconnaissance, lateral movement and exfiltration compressed into minutes rather than the human-paced timings your rules were tuned on
- Every AI system you operate treated as attack surface and tested adversarially, including the agents with tool access, the retrieval pipeline and the system prompts
- An authorisation model written for autonomous testing: what an agent may touch, what it must never touch, who signs, and how the boundary is enforced rather than requested
- Inventory of models in use across the business, including open-weight models pulled by engineering, because the graded one is not the risky one
- Third-party and supplier exposure retested on the assumption that a disclosed bug in their stack becomes a working exploit in days, not months
OpenAI graded its own model critical for cyber and shipped it with the brakes on. The brakes belong to OpenAI. The estate belongs to you, and the only honest way to know whether it holds at this new pace is to have someone run the chain against it and show you where it broke. We test AI systems and the infrastructure around them, and we hand back the path, the dwell time and the fix order in plain terms. Enterprise-grade. Not enterprise-priced. Start with your Threat Map.
References
Sources
- OpenAI. GPT-6 Astra. 3 September 2026. openai.com
- OpenAI. GPT-6 Astra System Card, Deployment Safety Hub. September 2026. deploymentsafety.openai.com
- CSO Online. OpenAI launches GPT-6 Astra, its first model to cross a critical cybersecurity threshold. 3 September 2026. csoonline.com
- The Hacker News. GPT-6 Astra Scores 100% on ExploitBench as OpenAI Blocks PoC Exploit Requests. 4 September 2026. thehackernews.com
- Axios. OpenAI releases new model GPT-6 Astra, says it may represent AGI. 3 September 2026. axios.com