Skip to main content
Google DeepMind researcher warns about irresponsible superintelligent AI push, showing a concerned scientist.

Editorial illustration for Google DeepMind Researcher Warns Superintelligent AI Push Is "Irresponsible

DeepMind Researcher Quits Over AI Safety Concerns

Google DeepMind Researcher Warns Superintelligent AI Push Is "Irresponsible

• 4 min read

Robert O'Callahan spent years building chip design tools at Google DeepMind's New Zealand office, work that made AI models cheaper and faster to run. He just quit, and he's not staying quiet about why. In a public resignation post, O'Callahan says the industry's "current rate of change is far too high" and that he can no longer justify the contribution he made to speeding it up.

He's not the first DeepMind employee to walk out the door citing safety concerns, and he says he won't be the last. O'Callahan claims many of his former colleagues privately share his worries about the pace of AI development but almost never say so in public. That silence, he suggests, is part of the problem.

His departure lands at a moment when the debate over AI risk has become tangled up with politics. Effective altruism, the movement associated with authors like Eliezer Yudkowsky, has drawn fire from critics who accuse it of prioritizing charity over redistribution, and Axios reports a White House memo recently painted the movement as cult-like while singling out Anthropic CEO Dario Amodei as the face of AI "doomerism."

O'Callahan calls the risk from superintelligent AI "real but uncertain" and says "aiming for ASI in the near future is inherently irresponsible." He also warns of cognitive surrender, AI-induced psychosis and loneliness, concentrated power, economic disruption, cybersecurity risks, and lack of accountability.

Why this matters

O'Callahan isn't a fringe critic tweeting from the sidelines. He built chip design tools that made AI training cheaper and faster, then walked away from that work because he couldn't square it with what he sees coming. That's a different kind of resignation than the usual "AI safety" op-ed.

For developers and founders building on DeepMind's tools, or racing to ship competing models, his list matters more than the headline: cognitive surrender, AI-induced psychosis, concentrated power, economic disruption. These aren't hypothetical policy debates, they're product design questions someone at Google is actively wrestling with. If insiders who helped build the infrastructure are now quitting over pace rather than capability itself, that's a signal worth more than another think-piece.

The risk being "uncertain," in O'Callahan's own words, cuts both ways: it's not an argument for slowing down or for barreling ahead. Watch whether DeepMind or its rivals respond with anything beyond a press statement. So far, the pattern is resignation letters, not roadmap changes.

Common Questions Answered

What was Robert O'Callahan's role at Google DeepMind before his resignation?

O'Callahan spent years building chip design tools at Google DeepMind's New Zealand office that made AI models cheaper and faster to run. His work directly contributed to accelerating AI development, which became central to his decision to leave the company.

Why did O'Callahan resign from Google DeepMind?

O'Callahan quit because he believes the industry's current rate of change toward superintelligent AI is far too high and he can no longer justify his contribution to speeding up AI development. He publicly stated that aiming for artificial superintelligence in the near future is inherently irresponsible and poses real but uncertain risks.

What specific risks from superintelligent AI does O'Callahan warn about?

O'Callahan identifies multiple dangers including cognitive surrender, AI-induced psychosis and loneliness, concentrated power, economic disruption, cybersecurity risks, and lack of accountability. He characterizes the risk from superintelligent AI as real but uncertain, making the rush toward it particularly concerning.

Is O'Callahan the only Google DeepMind employee to quit over AI safety concerns?

No, O'Callahan is not the first DeepMind employee to walk out citing safety concerns, and he indicates he won't be the last. His resignation reflects a broader pattern of researchers within the company questioning the pace and direction of AI development.

Why is O'Callahan's resignation considered significant compared to typical AI safety criticism?

O'Callahan's resignation carries particular weight because he wasn't a fringe critic but rather an insider who built the actual tools accelerating AI training, then walked away from that work due to his safety concerns. His departure represents a concrete action backed by direct experience with the technology, rather than just theoretical commentary.

LIVE21:25Anthropic to Pay Akamai USD 11.6 Billion for Cloud Services