This paper investigates the problem of training-inference mismatch in reinforcement learning for large language models, where the training and inference processes can produce different results, leading to suboptimal training. A practitioner might care about this issue because it can lead to poor performance and instability in training, especially when using off-policy methods.
Firehose
Filtered to Papers, tagged “large language models” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives
Browse by tag
This paper helps prevent large language models from becoming unsafe by identifying training data that causes them to behave badly, even if the data itself looks harmless. Practitioners can use this technique to build safer language models that are more reliable and trustworthy.