Skip to main content
AI advisor Darji discusses safeguards for scaling AI, with a diverse group of founders listening intently.

Editorial illustration for AI advisors urge founders to add safeguards before scaling, says Darji

AI Founders Warned: Add Ethics Before Scaling Fast

AI advisors urge founders to add safeguards before scaling, says Darji

Updated: 3 min read

AI founders are betting the house on hype. Advisors like Darji say the math is already broken.

Companies building large language models command impossible valuations with almost no revenue to back them up. They lean on each other for infrastructure and funding, a chain of dominoes. Darji calls the structure a house of cards.

His advice is simple: stop scaling and install safeguards first. The alternative is a collapse everyone will later pretend was obvious.

Then that's the point at which I would take appropriate safeguards and bring it in," Darji notes. This philosophy may not suit every application, but it demonstrates how thoughtful consideration of data practices can align with both ethical concerns and practical development constraints. The current structure of AI companies, their valuations, and their revenue models may not be sustainable.

"I don't think a lot of people understand how, like, House of Cards, all these AI companies are right now," Darji cautions. "There just isn't enough revenue, at least for these large language models, to support the valuations that these companies have." Many leading AI companies remain privately held, making their financial details opaque to outside observers. Without public disclosures, it becomes difficult to assess whether current business models can actually support the massive investments being made.

The situation resembles earlier technology bubbles where excitement about potential overshadowed questions about sustainable profitability. "Within five to ten years, we'll all look back and be like, wow, that was so easy to see coming," Darji predicts, drawing parallels to previous asset bubbles. "It's kind of like the housing crash bubble where everybody realized that people were massively over-leveraged in their homes.

I think we're going to find that same sort of situation where those companies were all massively intertwined and over-leveraged." The interconnections between AI companies and their investors may amplify any eventual correction. When companies depend heavily on each other for infrastructure, funding, or market access, problems at one firm can cascade through the ecosystem. AI capabilities for prediction, pattern recognition, and automation remain valuable regardless of whether specific companies succeed or fail.

The underlying techniques will continue to improve and find practical uses across industries.

Common Questions Answered

What key warning do AI advisors consistently give to founders about product development?

Advisors are cautioning founders to pause and implement appropriate safeguards before scaling their AI products. They emphasize the critical moment when a model transitions from prototype to user-facing service, highlighting potential data handling liabilities that could emerge during this transition.

Why does Darji suggest taking 'appropriate safeguards' before bringing an AI model into production?

Darji believes that thoughtful consideration of data practices is crucial for aligning ethical concerns with practical development constraints. This approach recognizes that the current structure of AI companies and their revenue models may not be sustainable without careful, proactive risk management.

How do founders typically approach the development of AI products according to the article?

Founders are often focused on pushing performance metrics and rapidly shipping AI products, frequently overlooking the potential friction between their lofty goals and the practical challenges of deployment. This approach can lead to overlooking critical safeguards and potential data handling risks.

LIVE03:06Microsoft Confirms Copilot 'Super App' for This Year