AgentSWE: Can Coding Agents Build the Agent You Actually Want?
This paper creates a benchmark to test how well coding agents can build agents that meet their users' needs, and it finds that most agents fail to deliver what they promise. Practitioners might care because it highlights the need for better evaluation methods to ensure agents are built to meet user requirements.