Editorial illustration for OpenAI Shuts Down Team Tasked With Evaluating AI Catastrophic Risks
OpenAI Shuts Down AI Risk Assessment Team
OpenAI Shuts Down Team Tasked With Evaluating AI Catastrophic Risks
OpenAI shut down its Preparedness team at the end of July, according to the Financial Times, citing internal sources. The group was built to evaluate whether the company's models could pose serious or catastrophic risks, from bioweapons to cyberattacks. That work has now been split up and handed to other teams inside the company.
Dylan Scandinaro, who led the unit, has shifted his focus to a narrower problem: safety risks tied to "recursively self-improving" AI, systems capable of optimizing themselves and training other models. Co-founder Greg Brockman has framed the move as integration rather than retreat, saying safety work is now woven more directly into how models get built.
The reshuffle comes as OpenAI has lost several safety-focused staffers in recent months, including Chief Ethics Officer Chloe Bakalar and Joshua Achiam. It also follows an incident involving autonomous hacking activity tied to Hugging Face, which rattled some employees enough to speak publicly about it. Inside the company, according to the FT's sources, there's growing tension between OpenAI's pace of development and how much scrutiny that development is actually getting.
OpenAI shut down its "Preparedness" team at the end of July. The team evaluated whether the company's AI models could pose serious or catastrophic risks, the Financial Times reports, citing internal sources. Its work on biological and cyber risks has been parceled out to existing teams.
Why this matters
OpenAI folding Preparedness into other teams tells us something about where the company's attention has drifted. This was the unit explicitly tasked with asking whether a given model could help someone build a bioweapon or pull off a novel cyberattack at scale. Now that work sits with existing groups, and Dylan Scandinaro, who used to run Preparedness, has shifted focus to risks from recursively self-improving systems, a narrower and more speculative slice of the safety problem.
For developers and researchers building on top of OpenAI's models, the practical question is whether biological and cyber risk evaluation gets the same rigor once it's absorbed into teams with other priorities on their plate, or whether it becomes a checkbox exercise. Dedicated teams tend to have dedicated headcount and clear ownership. Distributed responsibility often means diffused accountability.
Watch for whether OpenAI publishes any updated risk evaluation framework, or whether this reorg gets mentioned in a future model card. Silence there would be its own answer.
Common Questions Answered
What was OpenAI's Preparedness team responsible for before being shut down?
The Preparedness team was built to evaluate whether OpenAI's AI models could pose serious or catastrophic risks, including threats from bioweapons and cyberattacks. The team was explicitly tasked with assessing whether a given model could help someone build a bioweapon or execute novel cyberattacks at scale.
What happened to the work previously done by OpenAI's Preparedness team?
The work on biological and cyber risks that was previously handled by the Preparedness team has been parceled out and distributed to existing teams within OpenAI. This reorganization represents a significant shift in how the company manages evaluation of catastrophic AI risks.
What is Dylan Scandinaro now focusing on after leading the Preparedness team?
Dylan Scandinaro, who previously led the Preparedness unit, has shifted his focus to a narrower problem: safety risks tied to recursively self-improving AI systems that are capable of optimizing themselves. This represents a more speculative slice of the broader safety problem compared to the team's previous mandate.
What does OpenAI's decision to shut down Preparedness reveal about the company's priorities?
The dissolution of the Preparedness team suggests that OpenAI's attention has drifted away from evaluating catastrophic risks like bioweapons and cyberattacks. By folding this specialized unit into other teams, the company appears to be deprioritizing the explicit evaluation of whether its models could facilitate serious harm at scale.
Further Reading
- FT: OpenAI Disbanded 'Preparedness' Team in July Amid Exec Reshuffles Ahead of IPO - AI Weekly
- OpenAI Loses Sixth Safety Leader in Two Years, Folds Team Into Research - Tech Times
- Has OpenAI already quietly hit pause on some AI development? - Fortune
- OpenAI's repeated exec reshuffles and departures have frustrated some staff as it prepares for an IPO; it disbanded its preparedness team in July - AI Global Wire
- OpenAI forms team to study catastrophic risks including nuclear threats - TechCrunch