#71 - ZAK JOST (Graph Neural Networks + Geometric DL) [UNPLUGGED]
About this episode
Special discount link for Zak's GNN course - https://bit.ly/3uqmYVq
Patreon: https://www.patreon.com/mlst
Discord: https://discord.gg/ESrGqhf5CB
YT version: https://youtu.be/jAGIuobLp60 (there are lots of helper graphics there, recommended if poss)
Want to sponsor MLST!? Let us know on Linkedin / Twitter.
[00:00:00] Preamble
[00:03:12] Geometric deep learning
[00:10:04] Message passing
[00:20:42] Top down vs bottom up
[00:24:59] All NN architectures are different forms of information diffusion processes (squashing and smoothing problem)
[00:29:51] Graph rewiring
[00:31:38] Back to information diffusion
[00:42:43] Transformers vs GNNs
[00:47:10] Equivariant subgraph aggregation networks + WL test
[00:55:36] Do equivariant layers aggregate too?
[00:57:49] Zak's GNN course
Exhaustive list of references on the YT show URL (https://youtu.be/jAGIuobLp60)
Get every episode summarized
Each time Machine Learning Street Talk (MLST) publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
More from Machine Learning Street Talk (MLST)
How Replication Could Teach Machines What Good Science Looks Like — Edward Hughe...
Machine Learning Street Talk (MLST)
AI 2040: Plan A report - Daniel Kokotajlo & Thomas Larsen
Machine Learning Street Talk (MLST)
Designing How AI Grows — Tom McGrath
Machine Learning Street Talk (MLST)
Stealing Reasoning Traces from Proprietary LLM APIs — Ilia Shumailov & Alexander...
Machine Learning Street Talk (MLST)