This paper investigates how training acceleration in diffusion transformers works and why it's important for practitioners to understand this process. By analyzing how the residual gate is reorganized during training, the authors found that this reorganization is a key factor in accelerating training, and they propose a simple method to promote this reorganization.
Firehose
Filtered to Papers, tagged “training acceleration” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives