Runway’s WorldPrompt and the Engineering of Real-Time Worlds
Artikelbild eller återanvändbart omslag för Latent Space
Earlier this month, world model company Runway introduced GWM Worlds 2, a research preview that “turns high-fidelity video and audio generation into real-time interactive simulation.” Runway calls this an “autoregressive diffusion” model; with autoregressive describing how it generates over time.One new feature in particular caught our eye: WorldPrompt, a proposed input format for specifying a generated world and the actions within it.
It allows you to fix some aspects of a simulated environment — including the first frame — and then create a series of timestamped events. The events, or actions, can even be prompted in real-time.To understand the implications of WorldPrompt, we spoke to Kamil Sindi, Runway’s CTO, and Robin Kahlow, its Principal Research Scientist for generative video and multimodal AI.
Texten är källans egen beskrivning av publiceringen. Innehållet tillhör Latent Space.
Mer att läsa
Building advertising for the way people use AI
OpenAI för 1 tim sedan
Server-Side Code Execution Tools for AI Agents, Compared
OpenRouter för 11 tim sedan
v0.40.0
Ollama för 11 tim sedan
Google froze its open source bug bounty program due to a ‘significant rise’ in AI submissions
TechCrunch AI för 15 tim sedan