Skip to content
TrackPodcasts
technologyFeb 13, 202642:52pending

AI incidents, audits, and the limits of benchmarks

Practical AI

About this episode

AI is moving fast from research to real-world deployment, and when things go wrong, the consequences are no longer hypothetical. In this episode, Sean McGregor, co-founder of the AI Verification & Evaluation Research Institute and also the founder of the AI Incident Database, joins Chris and Dan to discuss AI safety, verification, evaluation, and auditing. They explore why benchmarks often fall short, what red-teaming at DEFCON reveals about machine learning risks, and how organizations can better assess and manage AI systems in practice.

Featuring:

Links:

Upcoming Events: 

Get every episode summarized

Each time Practical AI publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.

Email me new episodes

Free for 3 shows. No card needed.

No transcript yet

This episode has not been transcribed. Request it and it moves to the front of the queue.

AI incidents, audits, and the limits of benchmarks

Practical AI

0:00
42:52

More episodes

More from Practical AI

View all episodes →