Exhaustion of High-Quality Data Could Slow Down AI Progress in Coming Decades
About this episode
Pablo Villalobos is a Staff Researcher at Epoch, and lead author of the recent paper “Will we run out of data? An analysis of the limits of scaling datasets in Machine Learning”. We discuss the key findings in this paper, as well as a related study Pablo conducted on scaling laws.
Subscribe to the Gradient Flow Newsletter: https://gradientflow.substack.com/
Subscribe: Apple • Spotify • Stitcher • Google • AntennaPod • Podcast Addict • Amazon • RSS.
Detailed show notes can be found on The Data Exchange web site.
Get every episode summarized
Each time The Data Exchange with Ben Lorica publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
More from The Data Exchange with Ben Lorica
Your AI Agent Is Costing You More Than You Think
The Data Exchange with Ben Lorica
Reasoning Doesn't Start With Language
The Data Exchange with Ben Lorica
An Agent Is Just an LLM in a For-Loop
The Data Exchange with Ben Lorica
The Bloomberg Terminal for AI Compute
The Data Exchange with Ben Lorica