Skip to content
TrackPodcasts
scienceFeb 21, 20265:52pending

Smallest Addition Transformer

About this episode

We dive into the race to build a perfectly accurate 10-digit addition model with under 7,000 parameters, comparing ClaudeCode’s data-forward approach with reversed output to Codex’s token-based compression. Along the way, we explore grokking, data formatting tricks, and what these tiny models reveal about AI research and problem-solving at scale.


Note:  This podcast was AI-generated, and sometimes AI can make mistakes.  Please double-check any critical information.

Sponsored by Embersilk LLC

Get every episode summarized

Each time Intellectually Curious publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.

Email me new episodes

Free for 3 shows. No card needed.

Hosts & guests

No transcript yet

This episode has not been transcribed. Request it and it moves to the front of the queue.

Smallest Addition Transformer

Intellectually Curious

0:00
5:52

More episodes

More from Intellectually Curious

View all episodes →