PAR: Progress-Aligned Recurrence for Length Generalization in State Tracking
This paper proposes a new training method called Progress-Aligned Recurrence (PAR) to improve the performance of sequential state-tracking models on longer problems. By training the model to match the state after a certain number of operations and rescaling recurrent states, PAR enables models to generalize better to longer problems.