About this episode
And why the comparisons don't really matter. Repeated patterns in the race for reproducing ChatGPT, another year of evaluation crises, and people who will take awesome news too far.
This is AI generated audio with Python and 11Labs
Source code: https://github.com/natolambert/interconnects-tools
Original post: https://www.interconnects.ai/p/open-gpt4-limitations
00:00 Where 2024's "open GPT4" can't match OpenAI's
03:19 Models vs. products
04:51 RLHF progress: Revisiting Llama 2's release and potential in 2024
08:30 Smaller scale open RLHF
10:33 Opportunities
12:24 Commentary
This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.interconnects.ai/subscribe
Get every episode summarized
Each time Interconnects publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
More from Interconnects
I wrote an AI textbook — how long until AI can do it better?
Interconnects
Open models recap: more on Kimi K3, Qwen 3.8, Xi's WAIC speech, distillation, th...
Interconnects
Kimi K3: The open-weights escalation
Interconnects
GLM-5.2 is the step change for open agents
Interconnects