Editorial illustration for New in‑app browser lets users comment on pages to guide Codex, aiding game dev
AI Browser Lets Devs Guide Codex with Live Web Comments
New in‑app browser lets users comment on pages to guide Codex, aiding game dev
Forget circling a screenshot with vague red arrows. Most design feedback evaporates before it hits the code. Codex just changed that.
Its new in-app browser lets you drop comments and commands directly onto the live page itself. Tell it to move a button left. Swap an image.
Change that blue. The AI sees your markup on the actual canvas, turning abstract notes into direct orders.
The app now includes an in-app browser, where you can comment directly on pages to provide precise instructions to the agent. This is useful for frontend and game development today, and over time we plan to expand it so Codex can fully command the browser beyond web applications on localhost. Codex can now use gpt-image-1.5(opens in a new window) to generate and iterate on images.
Combined with screenshots and code, it is helpful for creating visuals for product concepts, frontend designs, mockups, and games inside the same workflow. We're also releasing more than 90 additional plugins, which combine skills, app integrations, and MCP servers to give Codex more ways to gather context and take action across your tools.
The addition of OpenAI's new gpt-image-1.5 model is key here. So are the ninety-plus new plugins. This means one agent can now generate a game sprite, tweak the surrounding code, and adjust the layout—all from annotated instructions in a browser tab.
That’s not a simple update. It collapses the border between giving feedback and changing the product itself. For developers building interfaces, the tedious loop of description is vanishing.
The workspace is now the page.
Related Reading
AI Tools & Apps Claude gains shared context in Excel, PowerPoint; Microsoft adds Copilot Cowork
AI Tools & Apps Windows Copilot AI unable to pinpoint image source in user test
AI Tools & Apps LG's recent webOS update adds Microsoft Copilot app, now removable
From Archives AI cuts costs as 35% of teams replace SaaS, 78% plan builds by 2026
From Archives Canva AI 2.0 adds orchestration layer for unified prompt‑driven design tools
Common Questions Answered
How does the new in-app browser enhance Codex's capabilities for developers?
The in-app browser allows developers to comment directly on web pages, providing precise instructions to the Codex AI agent. This feature is particularly useful for frontend and game development, enabling more granular control and interaction with web content during the development process.
What image generation capabilities has Codex recently added?
Codex can now use gpt-image-1.5 to generate and iterate on images, working in conjunction with screenshots and code. This capability is especially helpful for creating visuals for product concepts and frontend design.
What are the future plans for Codex's browser functionality?
The development team plans to expand Codex's browser capabilities beyond web applications on localhost, with the goal of allowing the AI agent to fully command the browser. This represents a broader vision of integrating AI more deeply into the development workflow.
Further Reading
- Introducing the Codex app — OpenAI
- Create browser-based games | Codex use cases — OpenAI Developers
- The Codex App — Hacker News
