FDE-Gym: The Last Mile of AI Delivery
This paper creates a benchmark for evaluating AI systems in real-world customer delivery scenarios, where agents must clarify ambiguous requirements, work in live systems, and uncover unstated constraints. Practitioners might care because it highlights the challenges of delivering effective AI systems in complex, real-world environments.