This episode argues that current AI progress is primarily driven by an immense quantity of high-quality, task-specific data, rather than improvements in sample efficiency. The speaker highlights the vast data requirements of frontier models…
Firehose
Filtered to tagged “Scaling laws” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives
Browse by tag
artificial intelligence 57continual learning 24agentic coding 21open-weight models 20AI 16AI agents 13reinforcement learning 11cybersecurity 9AI safety 8finance 8language models 7large language models 7open-source 7productivity 7deep learning 6machine learning 6natural language processing 6Reinforcement learning 6tech 6Databricks 5robotics 5software development 5Agentic AI 4benchmarking 4Diffusion models 4multi-agent systems 4Recursive self-improvement 4world models 4AI ethics 3AI infrastructure 3
Alex Rives, Head of Science at Biohub, discusses ESM-C, a fourth-generation protein language model that leverages the "Bitter Lesson" of scaling with massive metagenomic datasets to achieve unprecedented protein structure prediction and des…
Eric Jang explains how to build AlphaGo from scratch using modern AI tools, detailing the game of Go's rules and the core Monte Carlo Tree Search (MCTS) algorithm. He describes how deep neural networks, specifically value and policy network…