Filtered to diffusion transformers · clear filter
This paper introduces a large-scale music generation model called StepAudio 3 Music, which can create long-form music and respond to text prompts. Practitioners might care about this model's ability to generate music with structure and coherence.
This paper helps us understand how text-to-image diffusion transformers work by analyzing the role of "template tokens" in generating images from text prompts. Practitioners might care because it shows how to improve the efficiency of these models without sacrificing their performance.
This paper develops a system called AlayaWorld that can generate interactive virtual worlds from text, images, or videos, allowing for customizable and evolving environments. Practitioners in areas like game development, virtual reality, or interactive storytelling might care about this research for its potential to streamline the creation of immersive experiences.
This paper improves monocular depth estimation models by repurposing image generation models, using a diffusion transformer architecture, to produce sharper and more detailed depth maps that generalize well to out-of-distribution inputs. Practitioners might care about this research because it could lead to better performance in applications such as scene reconstruction and computational photography.