Explorative Modeling: Unlocking a Third Pretraining Axis and End-to-End Generation
This paper introduces Explorative Modeling, a new approach to training generative models that allows for end-to-end generation by exploring multiple candidate matches between model generations and data. This can lead to improved performance and efficiency in various applications.