Papers

Filtered to on-policy methods · clear filter

Browse by term

continual learning 91reinforcement learning 43vision-language models 18benchmarking 12benchmarks 11robotics 11large language models 10language models 9world models 9video generation 6generative models 5multimodal models 5natural language processing 5recursive self-improvement 5video world models 5agents 4dialogue systems 4diffusion models 4foundation models 4multimodal large language models 4on-policy distillation 4reasoning 4self-distillation 4self-supervised learning 4conversational AI 3evaluation benchmarks 3human-computer interaction 3LLMs 3multi-agent systems 3policy optimization 3

Matching papers

On-Policy Self-Distillation without Any Supervision

183 upvotes · 9 AUG 2026 · Yijiang Li, Bingyang Wang, Yijun Liang et al.

This paper shows how to make large language models improve themselves without needing external guidance or supervision, by using their own internal consistency to correct mistakes. Practitioners might care about this because it could lead to more robust and self-sufficient AI models.

self-distillationon-policy methodsunsupervised learninginternal consistencyreinforcement learningcontinual learning

Does On-Policy Distillation Really Distill? From Noisy Teacher to Self-Improvement

89 upvotes · 31 AUG 2026 · Yi Ding, Ruqi Zhang

This paper investigates whether on-policy distillation (OPD) truly improves student policies by analyzing the effects of noisy teacher supervision. It finds that OPD works by suppressing low-probability tokens, which can be achieved without a teacher, and introduces a new method called On-Policy Self-Adaptation (OPSA) that outperforms OPD and traditional reinforcement learning methods.

reinforcement learningon-policy methodsself-supervised learningpolicy distillationcontinual learning