AI agents failed to pass DAYJOB: Tax, a benchmark evaluating their ability to handle complex, real-world tax work, including navigating messy records, identifying consequential issues, and making professional judgments with incomplete information. The top-performing agent, Opus 5.5, achieved a 9.2% pass rate, while others, such as Astra and Claude Sonnet 5.5, performed significantly worse. AI summary
Firehose
Filtered to tagged “taxation” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives
Browse by tag
artificial intelligence 70continual learning 27AI 18open-weight models 15reinforcement learning 14agentic coding 12AI agents 11large language models 9tech 9AI safety 7benchmarks 7finance 7open-source 7robotics 7language models 6machine learning 6Reinforcement learning 6Diffusion models 5game development 5natural language processing 5Agentic AI 4anthropic 4computer vision 4cybersecurity 4data integration 4deep learning 4Recursive self-improvement 4Vercel 4video games 4AI infrastructure 3