AI and Existential Risk - Overview and Discussion
About this episode
A special non-news episode in which Andrey and Jeremie discussion AI X-Risk!
Please let us know if you'd like use to record more of this sort of thing by emailing [email protected] or commenting whether you listen.
Outline:
(00:00) Intro
(03:55) Topic overview
(10:22) Definitions of terms
(35:25) AI X-Risk scenarios
(41:00) Pathways to Extinction
(52:48) Relevant assumptions
(58:45) Our positions on AI X-Risk
(01:08:10) General Debate
(01:31:25) Positive/Negative transfer
(01:37:40) X-Risk within 5 years
(01:46:50) Can we control an AGI
(01:55:22) AI Safety Aesthetics
(02:00:53) Recap
(02:02:20) Outer vs inner alignment
(02:06:45) AI safety and policy today
(02:15:35) Outro
Links
Taxonomy of Pathways to Dangerous AI
Existential Risks and Global Governance Issues Around AI and Robotics
Current and Near-Term AI as a Potential Existential Risk Factor
AI x-risk, approximately ordered by embarrassment
Classification of Global Catastrophic Risks Connected with Artificial Intelligence
X-Risk Analysis for AI Research
The Alignment Problem from a Deep Learning Perspective
See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.
Get every episode summarized
Each time Last Week in AI publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
More from Last Week in AI
#255 - Gemini 3.7, Jalapeño, Qwen 3.8, Drones
Last Week in AI
#254 - Rogue AI hacking, bio-weapons, Dean & Hassabis out
Last Week in AI
#253 - Opus 5, Gemini 3.6, Kimi K3, Hugging Face Hack
Last Week in AI
#252 - GPT 5.6, Grok 4.5, Nemotron-Labs-Diffusion, AI 2040
Last Week in AI