This paper introduces a new method called Weakening-Induced On-Policy Self-Distillation that helps improve reasoning models without needing a strong teacher model. Practitioners might care because it can be used to improve model performance even when a good teacher model is not available.
Firehose
Filtered to Papers, tagged “reasoning” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives