Releases·Model Release
Runway launches GWM Worlds 2 research preview for real-time interactive world simulation
Runway announced GWM Worlds 2, a research preview for real-time interactive world simulation built on its foundational audio-visual generation model. The system generates continuous 720p video at 24 fps with 48 kHz audio that responds dynamically to user inputs like movement, dialogue, and weather changes, rather than relying on pre-scripted clips. It matters to practitioners as an early playable world model in the growing real-time generative simulation space.
69 engagement1 sourceThu, Sep 3, 2026, 06:01 PM
AI Overview
- Runway's GWM Worlds 2 generates 720p video at 24 fps and 48 kHz audio in real time, responding to user inputs rather than pre-scripted clips.
- A WorldPrompt system combines a persistent genesis prompt and reference frame with a timestamped event stream for camera movement, speech, and gestures.
- The model is an autoregressive diffusion video-audio system conditioned on global context, frame-level actions, and past frames via a sliding KV-cache.
- GWM Worlds 2 offers Ahead-of-Time, Turn-Based, and Real-Time modes, plus multi-role LiveKit sessions and an LLM assistant for drafting prompts and keybindings.
- Limitations include fidelity loss from real-time speed, geometry and texture drift during rapid camera moves, and lacking real-time state tracking.
Entities
Related
Releases·Model Release
Runway's GWM Worlds 2 Adds WorldPrompt for Real-Time Interactive World Generation
Runway introduced GWM Worlds 2, a research preview that turns high-fidelity video and audio generation into real-time interactive simulation, and detailed its new WorldPrompt input format in interviews with CTO Kamil Sindi, Principal Research Scientist Robin Kahlow, and co-CEO Anastasis Germanidis. WorldPrompt lets users fix parts of a simulated environment and prompt timestamped, real-time events, differentiating Runway from Genie 3, Odyssey-2 Pro, and World Labs' RTFM. The work matters to practitioners because real-time autoregressive world generation remains an open engineering problem with limits in error accumulation, memory, and counterfactual realism.
Runway introduced GWM Worlds 2, a research preview that turns high-fidelity video and audio generation into real-time interactive simulation, and detailed its new WorldPrompt input format in interviews with CTO Kamil Sindi, Principal Research Scientist Robin Kahlow, and co-CEO Anastasis Germanidis. WorldPrompt lets users fix parts of a simulated environment and prompt timestamped, real-time events, differentiating Runway from Genie 3, Odyssey-2 Pro, and World Labs' RTFM. The work matters to practitioners because real-time autoregressive world generation remains an open engineering problem with limits in error accumulation, memory, and counterfactual realism.
0 engagement1 sourcerssFri, Sep 25, 2026, 01:30 AM
Releases·Model Release
Astronex-World 1.0: Real-Time Interactive World Model Foundation
Astronex-World 1.0 is an open controllable video world-model foundation supporting text-to-video and image-to-video generation under camera trajectories, continuous actions, and inserted text events. Built on a 5B prior, it streams 832x480 video at 24 fps in real time on a single GPU and outperforms larger 13.6B–14B models on WBench. Its reserved action interfaces enable post-training for embodied intelligence and autonomous driving.
Astronex-World 1.0 is an open controllable video world-model foundation supporting text-to-video and image-to-video generation under camera trajectories, continuous actions, and inserted text events. Built on a 5B prior, it streams 832x480 video at 24 fps in real time on a single GPU and outperforms larger 13.6B–14B models on WBench. Its reserved action interfaces enable post-training for embodied intelligence and autonomous driving.
0 engagement1 sourcearxivThu, Sep 17, 2026, 10:38 AM
Releases·Model Release
AlayaWorld open-source video world model released with 720p 24 FPS streaming and camera control
AlayaWorld is a full-stack, open-source video world model that supports 720p, 24 FPS streaming video generation with camera control and text-driven event generation. It is built around four core properties: interaction, consistency, stability, and runtime.
AlayaWorld is a full-stack, open-source video world model that supports 720p, 24 FPS streaming video generation with camera control and text-driven event generation. It is built around four core properties: interaction, consistency, stability, and runtime.
64 engagement1 sourceredditWed, Jul 22, 2026, 03:46 AM
Developments·Paper
WorldSonus: real-time spatial audio generation for world models
A new arXiv paper, WorldSonus, presents an interactive video-to-audio framework that adds synchronized, spatially aligned sound to world-model-generated environments. It addresses real-time generation, mid-stream interactive sound control, and stereo spatial alignment, matching or beating bidirectional state-of-the-art models on open-domain video-to-audio benchmarks.
A new arXiv paper, WorldSonus, presents an interactive video-to-audio framework that adds synchronized, spatially aligned sound to world-model-generated environments. It addresses real-time generation, mid-stream interactive sound control, and stereo spatial alignment, matching or beating bidirectional state-of-the-art models on open-domain video-to-audio benchmarks.
0 engagement1 sourcearxivTue, Oct 6, 2026, 05:50 PM
Developments·Paper
ReWorld: An Interactive World Model with Long-Horizon Memory
ReWorld is a new interactive world model that separates control and memory during training, using mixed per-head attention windows and random head routing to handle long-horizon memory while streaming in real time. It addresses the structural tension between short-horizon control and unbounded memory.
ReWorld is a new interactive world model that separates control and memory during training, using mixed per-head attention windows and random head routing to handle long-horizon memory while streaming in real time. It addresses the structural tension between short-horizon control and unbounded memory.
0 engagement1 sourcearxivMon, Aug 24, 2026, 05:59 PM