Editorial illustration for AI Entrepreneur Builds Agents That Predict Future Outcomes
AI Entrepreneur Builds Predictive Agent Robots
AI Entrepreneur Builds Agents That Predict Future Outcomes
Danijar Hafner's office takes up a stretch of San Francisco's SoMa district, and it's nearly bare. No name on the door, one other person in the room, barely any furniture. What the space lacks in decor it makes up for in robots: humanoids of varying shapes and sizes hang from racks running down the middle of the room like marionettes waiting for a show.
Hafner is 31 and has spent years working on a specific problem in AI research, how to get agents to handle situations they never saw during training. His new startup, still in stealth, is the next chapter of that work, and the humanoid robots he imports from China give it a physical form. The stakes are practical.
A robot sent into someone's house has to cope with a floor plan and furniture arrangement it has never encountered before. Hafner's approach centers on model-based reinforcement learning, building world models that emulate physical reality and letting agents train inside them before facing anything real.
Unlike other efforts, Hafner’s technique enables agents and the robots they control to execute massively complicated tasks without the real-world trial-and-error training that’s traditionally been used in robotics.
Why this matters
Hafner's approach reframes what "world models" are for. Instead of just predicting the next frame in a video or the next token in a sequence, he's building agents that treat a learned model as a rehearsal space, one where a robot can imagine outcomes before it acts. For developers and founders, that's a different bet than the current wave of LLM-wrapped agents: it's a claim that planning ability, not just pattern matching, is what lets a system handle situations it's never seen.
If it works outside a lab, it could matter a lot for robotics companies that keep running into the same wall, brittle behavior the moment conditions shift from training. But stealth mode means no benchmarks, no deployed hardware numbers, nothing yet to test against the Boston Dynamics and Figure teams making similar promises. Hafner has a real research pedigree in this area, so the idea deserves attention.
Whether "dreaming" agents outperform simpler control methods in messy, real environments is still an open question, and one worth watching closely once something ships.
Common Questions Answered
What is Danijar Hafner's approach to training AI agents without real-world trial-and-error?
Hafner has developed a technique that enables agents and robots to execute complex tasks without requiring traditional real-world trial-and-error training in robotics. His method uses learned world models as a rehearsal space, allowing robots to imagine and plan outcomes before taking physical action in the real world.
How do Hafner's world models differ from traditional approaches to predicting sequences?
Unlike conventional world models that focus on predicting the next frame in a video or the next token in a sequence, Hafner's approach treats learned models as a rehearsal space for planning. This reframes world models as tools for enabling agents to handle unexpected situations through planning ability rather than just pattern matching.
What makes Hafner's planning-based agents different from current LLM-wrapped agents?
Hafner's approach prioritizes planning ability as the key to handling novel situations, whereas the current wave of LLM-wrapped agents relies primarily on pattern matching. His method represents a fundamentally different bet on what capabilities are necessary for systems to manage situations they've never encountered before.
What physical infrastructure does Hafner use to develop his AI agents?
Hafner's San Francisco office in the SoMa district contains multiple humanoid robots of varying shapes and sizes that hang from racks running down the middle of the room. These robots serve as the physical platforms for testing and developing his planning-based AI agents.
Further Reading
- Danijar Hafner - alphaXiv
- Danijar Hafner on alphaXiv - alphaXiv
- Mastering diverse control tasks through world models - Nature
- Training Agents Inside of Scalable World Models - Danijar Hafner
- Transcript: Danijar Hafner on Dreamer v4 - TalkRL