Filtered to video generation · clear filter
This paper develops a video personalization method that focuses on human-object interactions, aiming to improve the accuracy of video generation by better understanding human-object relationships and incorporating intra-subject references. Practitioners may care about this research as it could lead to more realistic and engaging video content.
This paper introduces a benchmark to evaluate video generation models' ability to reason about physical laws, which is crucial for creating reliable world simulators. Practitioners caring about developing more realistic and physically intelligent AI models will find this research valuable.
This paper improves the efficiency of video generation by reducing the computational load of attention, a key bottleneck in diffusion transformers. Practitioners can benefit from the speedup achieved by Sol-Attn, which enables faster video generation and editing without compromising visual quality.
This paper introduces a new task called multi-reference image-grounded video captioning, where models must describe video content while referencing multiple images. Practitioners might care because this can improve the accuracy and faithfulness of video captions in real-world applications.
This paper introduces a new method for generating videos in multi-agent environments, where each agent has its own view of the world. It's useful for applications like video games or simulations where multiple agents need to interact with each other and the environment.
This paper introduces Parallel Decoding Distillation (PDD), a new method to speed up image and video generation in diffusion and flow models, achieving state-of-the-art performance while improving video diversity. Practitioners might care about PDD's potential to accelerate video generation tasks.
This paper develops a more efficient way to generate high-quality videos by balancing the workload across multiple GPUs during training, which can improve the performance of video generation models like those used in FVAttn. Practitioners in video generation and deep learning might care about this research because it can lead to faster and more efficient video generation models.