28 upvotes · 28 JUL 2026 · Haolei Xu, Xiaowen Xu, Haiwen Hong et al.
This paper addresses a problem in on-policy distillation where a student model can get stuck on a wrong path, and proposes a new method called Relay-OPD that helps the student model recover by briefly taking over at certain points to produce a new trajectory. Practitioners might care about this because it could lead to better performance and more efficient training in models like language generators or math solvers.
23 upvotes · 29 JUL 2026 · Yihao Chen, Shi Chang, Khaled Chawa et al.
This paper teaches language models to synthesize complete software programs from scratch, which is a challenging task. Practitioners might care because this can improve the models' performance on software engineering tasks.
8 upvotes · 21 JUL 2026 · Shu Wei, Jingjing Wu, Lingshu Zhang et al.
This paper introduces HPD-Parsing, a new approach to document parsing that uses hierarchical parallel decoding to improve efficiency and throughput. Practitioners in natural language processing and computer vision might care because it could lead to faster and more accurate document parsing models.
6 upvotes · 24 JUL 2026 · Junlin Fang, Do Nguyen-Thanh, Xiaogang Xu et al.
This paper develops a method to clean up noisy signals in reasoning traces of large models to improve detection of hallucinations, which are false answers produced by models. Practitioners might care about this because it could lead to more accurate models that produce reliable answers.
6 upvotes · 29 MAY 2026 · Tzu-Heng Huang, Shengqi Qiu, Frederic Sala
This paper proposes a way to make automated evaluation systems more efficient, transparent, and reliable by distilling the decision logic of large language models into smaller, programmatic judges that can be easily inspected and edited. Practitioners might care because this approach could help reduce costs and improve the scalability of automated evaluation systems.