Firehose

This paper proposes a new method for evaluating role-playing agents (RPAs) that simulates user experiences in interactive role-playing to provide more accurate and personalized assessments of RPA capabilities. Practitioners might care about this because it helps them evaluate RPAs more effectively, leading to better systems that meet user needs.