#17 - Dan Hendrycks - Are AI worries overblown?

The rate of AI progress is accelerating, so how can we minimize the risks of this incredible technology, while maximizing the rewards?

Today I am speaking to leading AI researcher Dan Hendrycks — Dan is the founder of Center for AI Safety, and lead advisor to Elon Musk's X.AI. He was also the architect behind the "Mitigating Risks" letter that was signed by Demis Hassabis, Sam Altman, Bill Gates, Yoshua Bengio and many others.

In this conversation we discuss everything from immediate issues like deepfakes, to upcoming risks like malicious use, centralisation of power, regulatory capture and more. In other words, how do we ensure AI ends up a win/win for humanity instead of a lose/lose.

Chapters

00:00:00 - Intro

00:02:14 - Are current laws sufficient?

00:09:41 - Types of AI Risk

00:23:30 - Arms Races

00:39:10 - What happens inside an AI?

00:46:39 - Rogue AI

00:52:22 - Sentient AI

01:07:36 - Risks from Centralization

01:14:45 - Open Source

01:23:02 - AI speeding up systemic risks

01:29:54 - Synthetic Data & Simulations

01:36:52 - What Dan is excited about in AI

Links

♾️ An Overview of Catastrophic Risk Paper

https://arxiv.org/pdf/2306.12001.pdf

♾️ Center for AI Safety

https://www.safe.ai/ai-risk

♾️ Representation Engineering

https://www.ai-transparency.org/

♾️ Liv's Ted talk on AI & Moloch

https://www.youtube.com/watch?v=WX_vN1QYgmE

♾️ Norbert Wiener

https://en.wikipedia.org/wiki/Norbert_Wiener

♾️ Reinforcement Learning Textbook

https://inst.eecs.berkeley.edu/~cs188/sp20/assets/files/SuttonBartoIPRLBook2ndEd.pdf

♾️ Richard Posner - Economics Engine

https://plato.stanford.edu/entries/legal-econanalysis/

♾️ More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize

https://arxiv.org/abs/2203.06176

The Win-Win Podcast:

Poker champion Liv Boeree takes to the interview chair to tease apart the complexities of one of the most fundamental parts of human nature: competition. Liv is joined by top philosophers, gamers, artists, technologists, CEOs, scientists, athletes and more to understand how competition manifests in their world, and how to change seemingly win-lose games into Win-Wins.

Watch the previous episode with Boyan Slat of the Ocean Cleanup here:

https://youtu.be/QEYbLN-LC5k

Credits

♾️  Hosted by Liv Boeree

♾️  Produced & Edited by Raymond Wei

♾️  Audio Mix by Keir Schmidt