Editorial illustration for Anthropic CEO at Nasdaq Bell: AI Safety Now Requires "Double and Triple Checking
Anthropic CEO: AI Safety Needs Triple Checking
Dario Amodei stood at the Nasdaq podium on Thursday reading from a printed speech, a few hours after Anthropic's stock began trading in what's now the largest IPO on record. The moment could have been a straightforward victory lap. Instead, Amodei used it to repeat warnings he's been issuing since September, when he laid out a plan for pacing AI development that called for coordination among competing labs and independent evaluators checking safety claims. Sam Altman, Demis Hassabis, and Elon Musk all said they backed the idea, though none of them have committed to much that's concrete.
Amodei didn't open with stock prices or market caps. He opened with his father, who died of a disease that became treatable just a few years after his death. From there he moved to smallpox, polio, and the plague, diseases human intelligence had already beaten, and the much longer list of problems still waiting on scientists who don't have enough time or enough hands.
That's the case he's built for why Anthropic exists at all: AI as a partner in that unfinished work. What he said next, about keeping that work under human control even as the money and pressure pile up, is worth hearing in his own words.
As Anthropic made its Wall Street debut on Thursday in the largest IPO in history, CEO Dario Amodei reaffirmed the company’s commitment to developing AI responsibly. In his speech ahead of the Nasdaq opening bell, Amodei vowed that the AI company would not bend to either business or political pressure and would “remain under human control.”
Why this matters
Amodei's pledge landed at an odd address: the opening bell of the largest IPO on record, where the whole point is convincing shareholders to want more, faster. A CEO reading from a printout that he'll "pace the training" of frontier models is a strange thing to hear surrounded by Nasdaq traders whose job is pricing growth. For builders and researchers watching Anthropic, the real signal isn't the speech, it's whether the company's roadmap after this raise still looks like double-checking rather than doubling output.
Public companies answer to quarterly numbers, not origin stories about helping humanity. Worth tracking: how Anthropic frames safety spending in its first earnings calls, whether "remain under human control" shows up in actual product constraints or just investor decks, and whether new shareholders push back the moment a safety pause costs market share. Amodei set the bar himself, in public, with a stock ticker behind him.
That makes it measurable, and that's the part we'll be checking.
Common Questions Answered
What specific safety measures did Dario Amodei propose for pacing AI development?
Amodei's plan calls for coordination among competing AI labs and the implementation of independent evaluators to check safety claims. This approach aims to ensure that AI development proceeds responsibly rather than in an uncontrolled race between companies.
Why did Amodei emphasize AI safety concerns during Anthropic's record-breaking IPO?
Rather than using the Nasdaq opening bell moment as a straightforward victory lap, Amodei chose to reiterate warnings about responsible AI development and the need to keep AI systems under human control. This decision highlighted that the company prioritizes safety commitments over purely business-driven growth pressures.
What tension exists between Anthropic's commitment to pacing AI training and its role as a public company?
Amodei's pledge to pace the training of frontier models creates an unusual dynamic at the largest IPO on record, where shareholders and Nasdaq traders typically expect rapid growth and acceleration. This tension reflects the challenge of balancing responsible AI development with investor expectations for faster returns and expansion.
Who else has supported Amodei's vision for coordinated AI safety efforts?
The article mentions that Sam Altman, Demis Hassabis, and Elon Musk are among other industry leaders referenced in connection with Amodei's safety coordination proposals. These figures represent major players in the AI industry who share concerns about the need for responsible development practices.
Further Reading
- At Nasdaq opening bell, Anthropic CEO recommits to pacing AI development - TechCrunch
- Anthropic can’t reliably control its AI agents — it’s cutting off its internal evals from the live internet instead - TechCrunch
- Anthropic and OpenAI want to embed safety evaluators. Will they really be independent? - TechCrunch
- Building strong safety evaluations - Anthropic
- Anthropic CEO outlines plan to slow AI development - TechCrunch