CONNECT WITH US
AI & Deeptech

AI & Deeptech

Google’s Genie 4 world model adds audio, more realistic worlds, and real-time steering

TechCrunch – AI logo

Published on

Add as a preferred source on Google
Google’s Genie 4 world model adds audio, more realistic worlds, and real-time steering

Google DeepMind released its newest world model, Genie 4, in research preview on Tuesday. The latest model generates the most photorealistic and interactive worlds yet, allowing users to type prompts mid-simulation to change the scene. The model also generates real-time audio that matches the simulated world, including music, ambient noises, and interactive dialogue.

The release of Genie 4 comes a couple of months after AI video startup Runway released its second world model, GWM Worlds 2, a playable model that responds dynamically to user inputs and includes audio generation. At the same time, the world model industry is beginning to consolidate. Fei-Fei Li’s World Labs is being acquired by AMD, Amazon is in talks to buy Decart, and Rivian just acquired Third Dimension to bring simulation capabilities in-house for self-driving testing. 

Genie 4 is Google’s latest move to stay ahead in the crowded field. 

Google released its predecessor, Genie 3, as a research preview a little over a year ago. Aside from being far more photorealistic and featuring audio, Genie 4 allows for freeform edits, like changing the weather or camera angle in real time or adding new people or objects. It can maintain a consistent scene for up to two minutes, double its predecessor’s limit, and offers better physics and more human-like characters. 

Gemini, Google’s AI model, is also more closely integrated with Genie 4, acting as the director that plans steps and checks frames while Genie creates the visuals. In a research experiment tied to Gemini Robotics, a Gemini 4 Argon model broke down tasks into steps that Genie 4 simulated in real time.


Source link
Related Topics:AI & Deeptech

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.