Papers

Filtered to termination-token mismatch · clear filter

Browse by term

continual learning 91reinforcement learning 43vision-language models 18benchmarking 12benchmarks 11robotics 11large language models 10language models 9world models 9video generation 6generative models 5multimodal models 5natural language processing 5recursive self-improvement 5video world models 5agents 4dialogue systems 4diffusion models 4foundation models 4multimodal large language models 4on-policy distillation 4reasoning 4self-distillation 4self-supervised learning 4conversational AI 3evaluation benchmarks 3human-computer interaction 3LLMs 3multi-agent systems 3policy optimization 3

Matching papers

When EOS Tokens Disagree: Understanding Length Inflation in On-Policy Distillation

96 upvotes · 17 SEP 2026 · Yuxiao Yang, Tianrun Yu, Shangzhe Li et al.

This paper investigates why some AI models can generate excessively long responses and proposes a solution to mitigate this issue by aligning the models' termination tokens. Practitioners might care about this problem because it can lead to wasted generation budgets and inefficient AI applications.

on-policy distillationlength inflationEOS tokenstermination-token mismatchcontinual learning