Editorial illustration for Karpathy Spends USD 10 on Claude Opus to Render Tolkien in 3D
Karpathy Uses Claude to Build 3D Tolkien Scene for $10
Karpathy Spends USD 10 on Claude Opus to Render Tolkien in 3D
Andrej Karpathy fed Claude Opus 5 a single paragraph from the opening of "The Lord of the Rings" and asked it to build a 3D scene in the browser. Two hours later he had 5,500 lines of code, a working Three.js render of Middle-earth, and a bill of about ten dollars, drawn from a budget of one million tokens. The model placed and animated objects on its own, checking its work only through screenshots of its own output, which is where most of the mistakes crept in. Karpathy, who works at Anthropic, posted the source code so anyone can load up the scene and poke at it themselves.
He's framing this less as a formal benchmark and more as a gut check on where these models stand, the same way developers have used quick, odd prompts before to gauge progress. The reasoning: cheap, on-demand game worlds built from a few lines of prose are suddenly not far-fetched. But Karpathy is also pointing at a bigger problem in the field, one that Simon Willison's pelican-on-a-bicycle test was designed to solve and has apparently outgrown.
Karpathy calls the result rough but fun. Eleven Labs provided the audio, while the model placed and animated objects on its own. Nobody would build worlds like this by hand, Karpathy says, but with a model it's nearly free.
Why this matters Ten dollars and two hours to turn a paragraph of prose into a navigable 3D scene is a small number with big implications for how we judge model progress. Karpathy's benchmarks tend to stick, first the pelican-on-a-bicycle test, now Middle-earth, because they're cheap, visual, and hard to fake. That matters for developers and founders building on Claude or similar models: code generation is no longer just about passing unit tests, it's about whether a model can plan a scene, place objects, and animate them with only screenshot feedback, no real vision loop.
The mistakes Karpathy noted, errors introduced because Opus couldn't actually watch its own render, are the interesting part. They point to a concrete gap between token generation and spatial reasoning that researchers will need to close before "vibe coding" 3D worlds becomes reliable rather than a neat demo. Worth watching whether Anthropic or competitors respond with better self-checking tools, and whether Karpathy's informal tests get adopted as something closer to a standard.
Common Questions Answered
How much did it cost Andrej Karpathy to generate a 3D Middle-earth scene using Claude Opus?
The project cost approximately ten dollars and consumed about one million tokens from Claude Opus's budget. This relatively low cost demonstrates the affordability of using advanced AI models for complex creative tasks like 3D scene generation from text descriptions.
What framework did Claude Opus use to render the 3D scene in the browser?
Claude Opus used Three.js to render the 3D scene of Middle-earth in the browser. The model generated approximately 5,500 lines of code to create this working Three.js render based on a single paragraph from 'The Lord of the Rings' opening.
How did Claude Opus verify and check its work while building the 3D scene?
Claude Opus checked its work primarily through screenshots of its own output, which is where most of the mistakes in the project occurred. The model was able to place and animate objects independently, but relied on visual feedback from these screenshots to validate its progress.
Why does Karpathy consider his Middle-earth benchmark significant for measuring AI model progress?
Karpathy's benchmarks are significant because they are cheap, visual, and difficult to fake, making them reliable indicators of genuine model capability. Unlike traditional unit tests, this benchmark demonstrates whether a model can plan a complex scene, place objects appropriately, and generate functional code—skills that extend beyond simple code generation.
What additional technology did Karpathy use alongside Claude Opus for the Middle-earth project?
Karpathy used Eleven Labs to provide audio for the 3D scene, complementing the visual elements generated by Claude Opus. This combination created a more immersive experience of the rendered Middle-earth environment.
Further Reading
- Andrej Karpathy Says AI Has Moved Beyond Simple Prompts After Claude Opus Builds 3D Lord of the Rings World - Benzinga
- Opus 5 Renders the Lord of the Rings With a 1M-Token Budget - Developers Digest
- Claude builds 3D Lord of the Rings scene for ₹950; Anthropic exec calls it 'mind-boggling' - Inshorts
- 10美元、两小时、5500行代码,卡帕西让Claude Opus 5搭出《指环王》3D世界 - NetEase (163.com)
- Claude Opus 5 renders LoTR scene in Three.js - Blockchain.News