CoRT: Counterfactual Replay for Token-Level Rubric-Guided Policy Optimization
This paper proposes a method to improve language model training by allocating credit to individual tokens within a response, allowing for more nuanced evaluation of model performance. Practitioners may care about this method as it can lead to better language model performance, especially in tasks that require specific formatting or semantic choices.