This episode argues that current AI progress is primarily driven by an immense quantity of high-quality, task-specific data, rather than improvements in sample efficiency. The speaker highlights the vast data requirements of frontier models…
Firehose
Filtered to tagged “Scaling laws” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives
Browse by tag
artificial intelligence 89continual learning 27AI 23AI safety 13reinforcement learning 13agentic coding 12open-weight models 12AI agents 10machine learning 9AI ethics 8cybersecurity 8existential risk 8language models 8natural language processing 8ethics 7Reinforcement learning 6Diffusion models 5large language models 5multi-agent systems 5open-source 5recursive self-improvement 5robotics 5security 5software development 5Agentic AI 4artificial general intelligence 4mathematics 4Recursive self-improvement 4agents 3AI infrastructure 3
Alex Rives, Head of Science at Biohub, discusses ESM-C, a fourth-generation protein language model that leverages the "Bitter Lesson" of scaling with massive metagenomic datasets to achieve unprecedented protein structure prediction and des…
Eric Jang explains how to build AlphaGo from scratch using modern AI tools, detailing the game of Go's rules and the core Monte Carlo Tree Search (MCTS) algorithm. He describes how deep neural networks, specifically value and policy network…