Annotations as Rollouts: Efficient and Scalable Reinforcement Learning for Video MLLMs
This paper introduces a method called OraRL to improve the efficiency and scalability of reinforcement learning for multimodal large language models (MLLMs) trained on video data. By leveraging annotations as a source of high-quality rollouts, OraRL can significantly reduce the number of required rollouts, leading to faster training times and better performance on video understanding tasks.