Could Powerful AI Break Our Fragile World? (with Michael Nielsen)
About this episode
On this episode, Michael Nielsen joins me to discuss how humanity's growing understanding of nature poses dual-use challenges, whether existing institutions and governance frameworks can adapt to handle advanced AI safely, and how we might recognize signs of dangerous AI. We explore the distinction between AI as agents and tools, how power is latent in the world, implications of widespread powerful hardware, and finally touch upon the philosophical perspectives of deep atheism and optimistic cosmism.
Timestamps:
00:00:00 Preview and intro
00:01:05 Understanding is dual-use
00:05:17 Can we handle AI like other tech?
00:12:08 Can institutions adapt to AI?
00:16:50 Recognizing signs of dangerous AI
00:22:45 Agents versus tools
00:25:43 Power is latent in the world
00:35:45 Widespread powerful hardware
00:42:09 Governance mechanisms for AI
00:53:55 Deep atheism and optimistic cosmism
Get every episode summarized
Each time Future of Life Institute Podcast publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
More from Future of Life Institute Podcast
Why AI Hacking Is Becoming Hard to Control (with Benjamin Weinstein-Raun)
Future of Life Institute Podcast
First 24 Hours of a Bioweapon Attack - Annie Jacobsen
Future of Life Institute Podcast
How AI Shifts the Offense-Defense Balance in Biosecurity (with Paul-Enguerrand F...
Future of Life Institute Podcast
Why AI Evaluations Are Broken and How to Fix Them (with David Manheim)
Future of Life Institute Podcast