Skip to main content
Engineers in white lab coats examine Cerebras' massive wafer-scale AI chip on a lit workbench, its 5 nm grid visible.

Editorial illustration for Cerebras Unveils Wafer-Scale Engine 3: 5 nm Chip Boasts 4 Trillion Transistors

Cerebras Unveils Massive 4T Transistor AI Chip Breakthrough

Cerebras Wafer-Scale Engine 3: 5 nm, 4 trillion transistors, largest AI chip

Updated: 3 min read

Everyone is chasing Nvidia. Cerebras, a persistent underdog, just threw another giant silicon rock into the pond. They call it the Wafer-Scale Engine 3.

It’s big. It’s an affront to the normal way of doing things.

Making a chip means etching circuits onto a silicon wafer, then slicing that wafer into hundreds of individual processors. Cerebras skips the slicing. They build the entire wafer as one single, gargantuan chip.

It’s a concept that has failed others for decades. Cerebras keeps doing it. Their third attempt is the WSE-3.

This approach isn’t about subtle improvements. It’s a frontal assault on the fundamental bottlenecks in AI training, where moving data between hundreds of smaller GPUs often wastes more time than the computation itself. By keeping everything on one slab of silicon, Cerebras claims it can eliminate that chatter. The numbers are predictably absurd.

Below are some of the most noteworthy AI chips driving the next wave of AI infrastructure.

Four trillion transistors on a 5 nanometer process. The scale is difficult to comprehend. That’s roughly 56 times the transistor count of Nvidia’s current flagship H200. The 44 gigabytes of on-chip memory is a cache so vast it redefines the term, meant to keep a model’s entire state instantly accessible to those 900,000 cores.

All this for one purpose: training the next generation of trillion-parameter AI models without the paralyzing overhead of coordinating a small city’s worth of separate GPUs.

But wafer-scale is a high-wire act. Yields are a nightmare. A single microscopic flaw in the wafer can kill the entire chip.

Cerebras has engineered around this for years with redundant circuitry, but the economics remain brutal. The chip is less a product and more a statement of technical extremism. It proves a point.

The real question is whether anyone needs a single chip this monolithic, or if armies of smaller, connected processors are simply easier to build and replace.

Cerebras is betting the farm that their way is the future. Their rumored IPO plans suggest they’re ready to spend someone else’s money to find out.

Further Reading

Common Questions Answered

How does the Cerebras Wafer-Scale Engine 3 differ from traditional semiconductor chip designs?

Unlike conventional chip manufacturers that slice wafers into smaller processors, Cerebras builds an entire wafer as a single massive chip. This unique approach eliminates communication bottlenecks between processing units and allows for unprecedented computational density and performance.

What are the key technical specifications of the Wafer-Scale Engine 3?

The WSE-3 is fabricated on a 5 nm process and contains 4 trillion transistors, making it the largest single AI processor in existence. It features approximately 900,000 AI-optimized cores, delivers up to 125 petaflops of performance, and includes 44 GB of on-chip SRAM for rapid data access.

What potential impact could the Wafer-Scale Engine 3 have on AI computing?

The WSE-3 represents a radical reimagining of computational architecture that could significantly accelerate AI processing capabilities. By transforming an entire semiconductor wafer into a single, integrated processor, Cerebras has potentially solved critical performance bottlenecks that have traditionally limited AI computational speed and complexity.

LIVE03:21OpenAI's Miles Wang in Talks for USD 2B AI Drug Discovery Startup