Meta's AssetGen Aims to Build 3D Worlds From Text Prompts
At Meta Connect this year, the convergence of AI and virtual reality took center stage. Mark Zuckerberg used his keynote to outline a future where anyone can craft virtual worlds with AI-driven tools, pointing to upcoming capabilities in Meta Horizon Studio.
According to a recent episode of the Meta Tech Podcast, that future is closer than it might seem. Host Pascal Hartig sat down with Mahima and Rakesh from Meta's XR Tech team to discuss AssetGen, a new foundation model designed specifically for generating 3D assets.
The conversation digs into the nuts and bolts of how AssetGen was built and trained. The engineers also explore the pivotal role large language models (LLMs) are expected to play in the evolution of VR, and they detail the team's strategy for tackling the monumental challenge of producing full 3D worlds from simple text inputs.
