This paper introduces SciGame, a controlled benchmark for evaluating language model agents in scientific discovery, and finds that familiar priors can hinder performance, adaptive experimentation can be beneficial but also unfair, and that agents struggle to induce exact symbolic laws in unfamiliar settings.
Firehose
Filtered to tagged “Scientific discovery” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives
Browse by tag
artificial intelligence 70continual learning 27AI 18open-weight models 15reinforcement learning 14agentic coding 12AI agents 11large language models 9tech 9AI safety 7benchmarks 7finance 7open-source 7robotics 7language models 6machine learning 6Reinforcement learning 6Diffusion models 5game development 5natural language processing 5Agentic AI 4anthropic 4computer vision 4cybersecurity 4data integration 4deep learning 4Recursive self-improvement 4Vercel 4video games 4AI infrastructure 3
This episode features Alex Lupsasca from OpenAI, who discusses how AI, particularly GPT models, has achieved superhuman capabilities in theoretical physics, solving problems that puzzled human experts for over a year. He details the discove…