Urgent.News

What's breaking now, across thousands of outlets.

AI

Genie 4: A new generation of world simulation

Genie 4: our new world model unlocking unprecedented realism in real-time simulation.

Abstract editorial illustration

Google has unveiled Genie 4, a groundbreaking new world model designed to revolutionize real-time interactive simulation. This latest iteration of the Genie series brings unprecedented realism and the ability to generate audio, ambient noises, and interactive dialogue all within the same model.

At its core, Genie 4 builds upon the foundations laid by the Gemini family of models. Gemini Omni ensures the simulations accurately reflect real-world appearance and behavior, while other Gemini models provide the complex reasoning needed to maintain a coherent and continuous simulation.

With Genie 4, users can input events and see the world respond dynamically - how the environment looks, sounds, and how people move, react and speak in real-time. This technology has the potential to advance various fields, from training robots and AI agents to creating immersive interactive experiences.

In practical demonstrations, Genie 4 showcases its advanced capabilities. Users can steer the scene using standard keyboard controls, or provide natural language prompts to modify elements like the weather, camera angle, or introduce new objects into the simulation. Gemini continuously monitors and adjusts the scene to ensure the story flows naturally and coherently.

One of Genie 4's key strengths is its ability to simulate natural human speech and dialogue. Characters engage in real-time conversations that adapt to the current state of the world, responding dynamically to both user inputs and the unfolding events. This creates a far more lifelike and interactive simulation experience.

Google is taking a cautious approach with Genie 4, releasing it first as a research preview for trusted testers and developers. The company is gathering feedback to ensure the model meets safety standards and avoids generating harmful content before a wider public release. Strict safety guardrails have been implemented based on Google's existing policies.

As Genie 4 represents a major step forward in real-time world modeling, Google sees it as just the beginning. The company is exploring the potential of hybrid world models that combine the reasoning abilities of code and language models with the rich sensory representation of pixel-level simulation. This integration could unlock entirely new classes of AI-driven simulations.

Ultimately, Genie 4 marks a significant milestone in frontier research, merging real-time generation, photorealism, and advanced interactivity in a responsible manner. By leveraging the complementary strengths of Genie 4 and Gemini models, Google aims to create AI-driven simulations that are more coherent, controllable, and grounded in reality.

Written by urgent.news from Google DeepMind's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Also reported by 2 other outlets

Read the original at deepmind.google →

More in AI

More from Tuesday 27 October →