Papers

Filtered to trajectory-based methods · clear filter

Browse by term

continual learning 64reinforcement learning 34large language models 17benchmarking 12vision-language models 10generative models 8language models 8video generation 7multimodal models 6natural language processing 6robotics 6world models 6benchmarks 5diffusion models 5on-policy distillation 5policy optimization 5scalability 5self-distillation 5vision-language-action models 5autoregressive models 4computer vision 4diffusion transformers 4LLMs 4multimodal large language models 4verifiable rewards 4attention mechanisms 3embodied intelligence 3image editing 3long-term memory 3multimodal learning 3

Matching papers

Pass the Baton: Trajectory-Relayed On-Policy Distillation

28 upvotes · 28 JUL 2026 · Haolei Xu, Xiaowen Xu, Haiwen Hong et al.

This paper addresses a problem in on-policy distillation where a student model can get stuck on a wrong path, and proposes a new method called Relay-OPD that helps the student model recover by briefly taking over at certain points to produce a new trajectory. Practitioners might care about this because it could lead to better performance and more efficient training in models like language generators or math solvers.

on-policy distillationtrajectory-based methodscontinual learningreinforcement learningbenchmarks