Filtered to video world models · clear filter
This paper develops a system called AlayaWorld that can generate interactive virtual worlds from text, images, or videos, allowing for customizable and evolving environments. Practitioners in areas like game development, virtual reality, or interactive storytelling might care about this research for its potential to streamline the creation of immersive experiences.
This paper introduces Wonder, a system that can generate videos of a virtual world in real-time, allowing users to interact with and explore the environment. Practitioners in fields like video game development or virtual reality might care about this technology for its potential to create more immersive experiences.
This paper introduces ShadowDancer, a method for teaching video world models to perform any-action control by learning unified dynamics representations from a video and its shadow. Practitioners might care because it can improve action transfer and long-term control in complex environments.