SignalStack
Volver a noticias

Conoce a Genie 4 de Google DeepMind: Modelo de Mundo en Tiempo Real con Audio Nativo

Leer original

Resumen con IA

La integración de Genie 4 con un planificador Gemini en su generación de mundo en tiempo real con audio ofrece un plano arquitectónico crítico para la construcción de entornos de entrenamiento de IA avanzados.

Resumen generado con IA. Consulta el original para comprobar el contexto y la precisión.

Extracto de la fuente

Este es el extracto disponible del feed. Puede estar abreviado o en el idioma original.

Google DeepMind has released Genie 4 as a research preview for trusted testers. The Genie 4 world model generates explorable worlds from text and image prompts in real time. It also generates the soundscape: ambient noise, music and character dialogue. Users move with keyboard controls and steer events with plain-language prompts. The bigger change is architectural. A Gemini model now runs inside the simulation loop as a planner. That pattern is important for anyone building training environments for agents or robots. TL;DR Runs on: Google-hosted only (Project Genie web app, Gemini API early access). Performance: Photorealistic worlds with native audio and live text steering. Best: Scene consistency for up to 2 minutes, double Genie 3, per TechCrunch’s briefing. Worst: Sessions last a few minutes, and objects drift after repeated prompt edits. What is Genie 4? Genie 4 is a world model from Google DeepMind that simulates interactive environments frame by frame. It is not a video clip generator. Each frame responds to user input as it arrives. DeepMind states that the model is natively multimodal. Audio, music and dialogue are generated together with the visuals. It is DeepMind’s first real-time world model to generate audio natively. It succeeds Genie 3, announced in August 2025. Genie 3 ran at 720p and 24 frames per second, with visual memory reaching back 1 minute. How does Genie 4 use Gemini? Genie 4 borrows from 2 parts of the Gemini family. Gemini Omni anchors the look and behavior of each world. Other Gemini models handle the reasoning that keeps a simulation coherent. The runtime loop works like this: Interpret: When you type a prompt, Gemini adapts it to fit the running scene. Plan: Gemini 3.8 Flash breaks a goal into a sequence of steps. Verify: It reviews incoming frames to confirm each step succeeded. Adapt: If the world shifts or you intervene, it revises the plan. Between user inputs, Gemini also steers the scene so the world keeps pro

Sobre la prioridad

Una ayuda automática para ordenar, basada en fuentes, palabras clave y entidades, en una escala de 1–12. Alta: 9–12; media: 6–8; baja: 1–5. No mide urgencia, verifica noticias ni representa respaldo editorial.

Más sobre este tema

MIT AI News

Creación de máquinas que pueden escuchar

El desarrollo de máquinas con una audición superior permite aplicaciones críticas, como la localización rápida de accidentes, mejorando significativamente la percepción artificial más allá de las capacidades humanas.

Prioridad alta 12/12