Imagine creating a realistic world with a simple text prompt, changing the weather or camera angle instantly and hearing sounds that match every action. Google DeepMind is aiming to make this possible with Genie 4, a new AI model designed to create realistic, interactive simulations in real time.
Announced on October 27, Genie 4 combines realistic visuals, real-world physics, reasoning and audio generation to make virtual environments more lifelike. In a post on X, Google CEO Sundar Pichai described Genie 4 as the company’s "most realistic and interactive world model".
Google DeepMind has started rolling out Genie 4 as a research preview to trusted testers. The model is expected to become available to Google AI Ultra subscribers through Project Genie, as well as to early-access partners through the Gemini API and Google AI Studio.
Excited to share Genie 4 today our most realistic and interactive world model:
Genie 4 allows users to set events in motion and steer scenes in real time using natural language, including moving the camera, changing the weather or introducing new characters.
Genie 4 also draws on other Gemini models for the complex reasoning needed to maintain a simulation’s coherence and continuity.
One of Genie 4's key features is its ability to generate audio. This includes environmental sounds, background music and interactive dialogue between characters. The model also aims to create photorealistic scenes and simulate real-world physics.
Genie 4 builds on capabilities from Google' s Gemini family of models. Gemini Omni helps ground simulations in realistic appearances and behaviours, while other Gemini models provide reasoning capabilities to maintain continuity and coherence.
Source link







