Firehose

This paper proposes a method for generating infinite, interactive 3D worlds in real-time, using a compact 3D memory that stores scene information efficiently. Practitioners might care about this research if they need to generate realistic, interactive environments for applications like virtual reality or video games.

This paper proposes a new attention mechanism for video diffusion transformers that reduces the computational cost of inference by selectively computing attention only on key/value blocks. It improves the accuracy of attention at high sparsity levels, leading to faster inference times and better video quality.