Explainability, Reasoning, Priors and GPT-3
About this episode
This week Dr. Tim Scarfe and Dr. Keith Duggar discuss Explainability, Reasoning, Priors and GPT-3. We check out Christoph Molnar's book on intepretability, talk about priors vs experience in NNs, whether NNs are reasoning and also cover articles by Gary Marcus and Walid Saba critiquing deep learning. We finish with a brief discussion of Chollet's ARC challenge and intelligence paper.
00:00:00 Intro
00:01:17 Explainability and Christoph Molnars book on Intepretability
00:26:45 Explainability - Feature visualisation
00:33:28 Architecture / CPPNs
00:36:10 Invariance and data parsimony, priors and experience, manifolds
00:42:04 What NNs learn / logical view of modern AI (Walid Saba article)
00:47:10 Core knowledge
00:55:33 Priors vs experience
00:59:44 Mathematical reasoning
01:01:56 Gary Marcus on GPT-3
01:09:14 Can NNs reason at all?
01:18:05 Chollet intelligence paper/ARC challenge
Get every episode summarized
Each time Machine Learning Street Talk (MLST) publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
More from Machine Learning Street Talk (MLST)
AI 2040: Plan A report - Daniel Kokotajlo & Thomas Larsen
Machine Learning Street Talk (MLST)
Designing How AI Grows — Tom McGrath
Machine Learning Street Talk (MLST)
Stealing Reasoning Traces from Proprietary LLM APIs — Ilia Shumailov & Alexander...
Machine Learning Street Talk (MLST)
Every Exponential Ends — Silicon Valley Forgot — Adam Becker
Machine Learning Street Talk (MLST)