Ep 56: Distinguished Engineer at Waymo Vincent Vanhoucke Unpacks the Breakthroughs and Bottlenecks of Self-Driving

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. The company operates a 24/7 public ride-hail service and provides over 150,000 trips each week across San Francisco, Los Angeles, Phoenix, and Austin, making mobility more accessible, sustainable, and safer for everyone.

In this week’s episode of Unsupervised Learning, we dive deep into the frontier where AI meets hardware — and there’s no better guide than Vincent Vanhoucke, Distinguished Engineer at Waymo and former Head of Robotics at DeepMind.

 

[0:00] Intro

[0:50] Waymo's Technological Evolution

[2:40] The Role of LLMs in Autonomous Driving

[6:02] Vincent's Journey to Waymo

[9:17] Challenges in Autonomous Driving

[11:58] Simulation and World Models

[27:44] Future Milestones and Expansion

[30:10] Broader Robotics and AI

[36:12] Future of General Robotics Models

[38:14] Hardware vs. Software Approaches in Robotics

[40:19] Challenges in Robotic Data Acquisition

[40:38] Simulation vs. Real-World Data in Robotics

[43:02] Human-Robot Interaction for Data Collection

[45:03] Advancements in Multimodal Models

[47:08] Unanswered Questions in Robotics

[52:02] Reasoning Capabilities in AI

[54:57] Future of Robotics and AI

[1:00:51] Quickfire

 

With your co-hosts: 

@jacobeffron 

- Partner at Redpoint, Former PM Flatiron Health 

@patrickachase 

- Partner at Redpoint, Former ML Engineer LinkedIn 

@ericabrescia 

- Former COO Github, Founder Bitnami (acq’d by VMWare) 

@jordan_segall 

- Partner at Redpoint

Jacob is an AI investor at Redpoint Ventures. He's led Redpoint's investments in companies like Abridge, Physical Intelligence & Legora. Follow Jacob on Twitter (@jacobeffron).

On Unsupervised Learning we probe the sharpest minds in AI in search for the truth about what's real today, what will be real in the future and what it all means for businesses and the world. If you're a builder, researcher or investor navigating the AI world, this podcast will help you deconstruct and understand the most important breakthroughs and see a clearer picture of reality. Subscribe to this show to stay up to date on our latest episodes.