LiveMACE: Process-Aware Evaluation of LLM Agent Capabilities in Evolving Markets
This paper develops a new benchmark, LiveMACEBench, to evaluate the capabilities of large language model (LLM) agents in evolving financial markets. It shows that simply looking at the outcomes achieved by LLM agents can be misleading and introduces a new way to measure their capabilities.