Skip to main content
Andrej Karpathy, AI researcher, speaking at a conference about underestimating artificial intelligence capabilities.

Editorial illustration for Anthropic's Andrej Karpathy Says Public Underestimates AI Capabilities

Karpathy: Public Vastly Underestimates AI Capabilities

• 4 min read

Andrej Karpathy left OpenAI to join Anthropic earlier this year, and he's using his new perch to make a pointed argument: almost nobody outside a small circle of researchers actually knows what AI systems can do right now. In a recent post, Karpathy lays out a tiered breakdown of the roughly eight billion people on the planet and how each group interacts with large language models. The numbers are stark.

Six billion people, by his estimate, have barely touched an LLM. Another one to two billion use free chatbot tools the way they'd use a search engine or a grammar checker, treating them as a convenience rather than anything resembling real intelligence.

Karpathy's point isn't just about adoption curves. It's about the distance between what the public experiences and what happens inside labs like his own, where frontier systems are reportedly handling problems that would take trained specialists years to work through. He zeroes in on a narrow slice of professionals, maybe 20 million people in math and programming, who actually use these tools at the frontier of their capability. Fewer still, by his count, get to see the systems before they're released at all.

Andrej Karpathy, co-founder of OpenAI, describes a rapidly widening gap in how people understand AI capabilities. While the public treats chatbots like a better Google search, internal frontier systems are already tackling tasks that would take top experts years to complete.

Why this matters Karpathy's 20-million number is the detail worth sitting with. If that's roughly the pool of people actually stress-testing frontier models on hard math and code, then most public debate about AI, including a lot of what gets written here, is reacting to the demo version, not the tool itself. For developers and founders, that gap is where the opportunity sits: the capability ceiling is already higher than what's shaping consumer expectations or regulatory conversations.

For researchers, it's a reminder that benchmarks built around casual use cases will keep underselling what these systems can do on genuinely hard problems. We'd push back gently on taking Karpathy's framing at face value, since he has an obvious interest in hyping Anthropic's frontier work. But the underlying claim, that a small expert population is seeing something the other 75 percent isn't, deserves scrutiny rather than dismissal.

Worth watching: whether Anthropic or OpenAI ever publish real usage breakdowns by skill level, instead of leaving us to guess from one researcher's anecdote.

Common Questions Answered

What is Andrej Karpathy's main argument about public understanding of AI capabilities?

Karpathy argues that the general public significantly underestimates what AI systems can actually do, with most people only experiencing a limited preview of AI's true capabilities. He describes a stark divide where frontier AI systems are already tackling tasks that would take top experts years to complete, while the public primarily treats chatbots as an improved search engine.

According to Karpathy's breakdown, how many people have actually stress-tested frontier AI models?

Karpathy estimates that approximately 20 million people worldwide are actively stress-testing frontier models on challenging tasks like hard math and code problems. This represents a tiny fraction of the global population and highlights the significant knowledge gap between those working with advanced AI systems and the general public.

Why did Andrej Karpathy leave OpenAI to join Anthropic?

While the article doesn't explicitly state his reasons for joining Anthropic, it indicates he moved to the company earlier in the year and is now using his position to communicate his perspective on AI capabilities and public understanding of AI systems.

What opportunity does the gap between AI capability and public perception create for developers and founders?

The capability ceiling of frontier AI models is already higher than what's shaping consumer expectations and regulatory conversations, creating significant opportunities for developers and founders to build applications that leverage AI's true potential. This gap represents where real innovation and competitive advantage can be found in the AI space.

How does Karpathy categorize the world's population in terms of LLM interaction?

Karpathy breaks down roughly eight billion people into tiers based on their interaction with large language models, with approximately six billion people having barely touched an LLM and another one to two billion having minimal exposure. Only a small fraction of the global population has deep experience with frontier AI systems.

LIVE16:05Microsoft’s New AI Chip Promises 40% More Tokens Per Megawatt Than GPUs