
“The Scramble: getting in position to pace the frontier” by Peter Wildeford
About this episode
Crossposted from my Substack.
~
Suppose the President summons the AI CEOs and his top national security advisors to an emergency meeting at the White House.
He has become extremely concerned about superintelligence — the possibility that AIs far smarter than humanity combined slip beyond our ability to correct or shut down. If that happens, there is no way back. The President is concerned humanity could become permanently out of the driver's seat of its own future. He wants to figure out what to do.
The reaction is panic, chaos, confusion.
The President asks questions. The AI companies are blazing toward superintelligence at high speed — can we slow down as we approach the dangerous thresholds? …Some of the AI companies say they don’t have a good plan to slow down or stop, especially as their competitors may just undercut them if they do. What's that about?
What's going on with China — can we get them to pace as well? Can we get a deal without Beijing sneakily catching up and maybe surpassing us? And if there's no deal to be had, what then?
More like the Cuban Missile Crisis than the NPT
I sometimes hear people [...]
---
Outline:
(01:21) More like the Cuban Missile Crisis than the NPT
(03:24) A scramble and then three phases
(05:18) The scramble: What questions does the President ask?
(09:39) The mechanics of Phase 1
(12:37) A lot of verification work right now is focused on the wrong things
(14:49) What ought we do?
(17:36) Getting to a good scramble
(18:20) Footnotes
The original text contained 1 footnote which was omitted from this narration.
---
First published:
September 7th, 2026
---
Narrated by TYPE III AUDIO.
---
Images from the article:
Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
Get every episode summarized
Each time EA Forum Podcast (All audio) publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
Transcript ready
186 searchable segments. Every word is indexed and playable.
Full transcript
EA Forum Podcast (All audio) — “The Scramble: getting in position to pace the frontier” by Peter Wildeford. Machine-transcribed; use the interactive transcript above to jump the player to any line.
The scramble, getting in position to pace the frontier. By Peter Will DeFord, published on September 7, 2026. Cross-posted from my sub-stack. Roughly, suppose the President summons the AICOs and his top national security advisors to an emergency meeting at the White House. He has become extremely concerned about superintelligence, the possibility that AIC's far smarter than humanity combined slip beyond our ability to correct or shut down. If that happens, there is no way back. The President is concerned humanity could become permanently out of the driver's seat of its own future. He wants to figure out what to do. The reaction is panic, chaos, confusion. The President asks questions. The AIC companies are blazing towards superintelligence at high speed. Can we slow down as we approach the dangerous thresholds? Some of the AIC companies say they don't have a good plan to slow down or stop,
especially as their competitors may just undercut them if they do. What's that about? What's going on with China? Can we get them to pace as well? Can we get a deal without Beijing's sneakily catching up and maybe surpassing us? And if there's no deal to be had, what then? Heading. More like the Cuban Missile Crisis than the NPT. I sometimes hear people talking about treaties and other kinds of extensive international agreements as the way we would manage advanced AIC. But treaties typically take many years to operationalize. You want to be concrete and clear about your definitions. You want hundreds of technical experts on both sides informing nuanced diplomatic discussions about various details, numbers of missiles, types of missiles, timelines for disarmament, and so on. The Nuclear Non-Proliferation Treaty took three years of negotiation and two more years to implement. However, I expect that the moment the President is getting serious about
superintelligence won't feel like an extended treaty negotiation. It will feel less like the Nuclear Non-Proliferation Treaty and much more like the Cuban Missile Crisis. The Cuban Missile Crisis lasted 13 days. The vibes were insanely tense, stressful, chaotic, and confusing. The key decisions were limited to a group of roughly 15 individuals, the Executive Committee of the National Security Council, or XCOM, with President John F. Kennedy himself spending a great deal of time shaping and steering discussions. There was incomplete information, large uncertainty over the intentions of the Soviets, warring factions within the US and Soviet bureaucracies attempting to sway senior decision makers and a lot of chaos. I expect the initial phase of AI superintelligence management to share these features. There will not be a multi-year process to set up a technical bureaucracy that understands advanced AI risk or compute verification proposals. Instead, we move
forward with what we have. The President has to quickly make critical decisions that may lock us into particular paths. We rapidly develop a national strategy for what the US government does about recursive self-improvement, RSI, frontier model security, compute verification, technical evals, and safeguards, and China. Heading A Scramble and then three phases. How would we go from this presidential emergency meeting to a deal with China to pace the frontier? My rough sketch is it could proceed with a Scramble and then three phases. One. The Scramble roughly two to four weeks. The government has definitively decided they want to take strong action on superintelligence and has to get an initial deal done. Phase one, buying roughly three months. The interim deal. We make an interim deal to have time to get to a better deal. This may involve strict requirements on data centers above a certain
threshold to delay the training of an AI model that could do recursive self-improvement. This likely relies primarily on executive action. Here, monitoring and verification rely on traditional methods and nations are willing to agree to scrappy, Yankee, and invasive things. But we have a whole of government effort to build the tools for something more durable. Phase two, the durable deal. Phase one, interim deal, is meant to get us to phase two, where we have a stable deal between all nations where uncontrollable AI is reliably prevented. Congress has potentially been involved by this point, other countries are brought in, and the verification program matures into something that looks and feels more like a treaty than a haphazard Scramble. Phase three, safe superintelligence. If we want it, once we can figure out how to do it safely and have sufficient buy-in. The near-term intellectual work is unevenly distributed across this structure. Significant detail is ironed out during the Scramble and
during Phase one. There's an image here. Description. Flow chart of US China AI phases towards safe superintelligence. Heading, the Scramble. What questions does the President ask? The President launches an emergency meeting to figure out what to do about advanced AI, recursive self-improvement, and the road to superintelligence. Some questions that are likely on his mind. How dangerous is it to proceed through recursive self-improvement and superintelligence without pacing? How dangerous is it to proceed if we can't buy a few months? How much time do we actually need to buy? What is our best assessment of how likely we are to lose control over AI systems if we proceed with relatively unpaced recursive self-improvement? Can we pace without losing our lead over China? There's a list of bullet points here. What is our best assessment of how big our
lead is? How long would it take China to reach recursive self-improvement on their current trajectory? How much does this depend on the US's trajectory via things like distillation and also just routine study of US advances? What can we do to slow China down? What are our best disruption capabilities? What are our best monitoring methods? How well would we detect whether and when China is also approaching dangerous AI thresholds? Can we even afford to slow down for a month? What if deep-seek or moonshot comes up with a new algorithmic breakthrough? What if they steal the model weights to our best AI model? How confident are we that we can see all of China's major frontier AI projects? Could they be hiding large data centers that we don't know about? That's the end of the list. What do we do with the time we buy? What are our goals after phase 1 interim deal starts? Can we specify what phase 2 durable deal looks like in enough detail to
know when we've arrived? How valuable is more time for alignment research and better safe guards? For monitoring and verification approaches that could support a more enduring pacing program? For examining concentration of power and other governance issues unique to superintelligence? For each of these goals, how much value can we get from using trusted AI systems to make progress? And how should that affect the design of pacing itself? What exactly do companies agree to? And how is it verified? There's a list of bullet points here. What do companies agree to in the pacing charter in terms of both substantive commitments and verification commitments? Who needs to sign for the pledge to be meaningful? Is it a stop before RSI and make sure no one does RSI the right plan? How would we know when the condition has started to bind? Do we need a plan to also pace AIR and D and chip accumulation? If compute capacity keeps stockpiling during a pace, does there end up being a compute overhang?
Does it end up being dangerous? What model security agreements do we want if any? For instance, commitments toward SL5 grade security against nation state theft? What may I control agreements do we want if any, measures that keep systems safe even if they were trying to subvert oversight? How does safety research continue during pacing and how do you cap the capability gains it produces? Should compute be redirected to safety work or usage simply stopped? That's the end of the list. What does the deal with China actually look like? What is the US's best alternative to a negotiated agreement? What is China's? Under what circumstances would the US not want to deal at all? What are the US and China actually agreeing to in phase 1, interim deal and what are the mechanics of deal making? How does a deal like this actually get reached? What would cause China to trust a deal? What are the more specific carrots and sticks the US should
offer? What happens if the deal falls apart? How does graceful exit work? What conditions end pacing who signs off and how do you make the resumption process incentive aligned, rather than captured by whoever benefits from resuming or from never resuming? Heading. The mechanics of phase 1 Some have suggested we need a fancy higher assurance deal that the US should only make a deal with China once a suite of elaborate to bidetermined technical measures exists. I think we can better get thereby starting with a minimum viable slap dash deal that buys time to build the fanciest stuff. This is what phase 1, interim deal, is about. A few mechanisms for phase 1 that I currently find plausible. There's a list of bullet points here. Pacing is not about stopping now, but about stopping before recursive self-improvement. Pacing means slowing down at some point in the future from a much faster speed than we are currently going. Operationally, that means preventing unconstrained recursive
self-improvement since RSI is the most plausible on-ramp to systems that accelerate beyond our ability to understand or control them. A pacing charter. The president convenes the major frontier US AI companies to sign a charter covering both what they won't do and how they'll mutually verify it, to each other and to the US government. This would be voluntary, three, but the mutual verification would make it clear to everyone whether a company is following the charter or not. Dealmaking with China. The US has some latitude to implement some of phase 1 without China, due to having a lead over China, four. But the US is not willing and should not be willing to go too far down phase 1 without bringing China in on the deal. Nor should the US see too much US lead to China. The US has many carrots and sticks to get China to the table. Verification. In the scramble, the government likely doesn't have time to trust complicated technical verification tools. The large compute intensive training runs capable of recursive self-improvement
are likely only possible in a few data centers. For those data centers, we subject them to increased scrutiny. If there were tools already deployed and already understood by the national security community, those could be used. If not, the government will rely on tools it already trusts, intelligence services, spies, satellites and inspections. Operation warp speed to get to phase 2, durable deal. Phase 1 is buying us time, but during this delay the government is going all in on verification and other needed security measures. In the scenario where phase 1 happens at all, political buy-in is very high and the natural model is an operation warp speed for verification technology, a whole of government, maximal resources response. Recall that the federal COVID response provided about for $0.6 trillion in relief funding with broader estimates of the fiscal response running to $5.6 trillion. Even a tiny fraction of that scale would dwarf everything ever
spent on AI verification many fold. That's the end of the list. Heading. A lot of verification work right now is focused on the wrong things. Of course, despite major sustained attention from AI companies to the concept of pacing the frontier, it does not look like we are immediately about to enter a scramble. But we must be prepared to enter the scramble soon. This current era of building preparedness and optionality might be phase 0 and there's a lot of work to be done. Such questions related to phase 0 and sketching out the scramble and the plan for phase 1, interim deal is where I think the current AI security and verification communities should focus. This is because phase 1 likely involves multiple, rapid, critical and hard to reverse choices about how to approach recursive self-improvement. And everything after the scramble is better resource than everything before it. If the government buys time and we exit the scramble into phase 1, interim deal, the amount of talent and money going into verification and AI security explodes.
Prior to the scramble, there are fewer than 100 FTEs thinking seriously about monitoring and verification of frontier AI systems. Afterward, an increase of 2 to 3 orders of magnitude would not surprise me. With an even steeper increase in senior talent, people with decades of experience in red teaming, defending against nation state adversaries, arms control and non-proliferation. On top of that, it's plausible that highly capable AI systems themselves may be contributing significantly to the verification and security R&D. The resolution is to sort work by how necessary it is to sort out before or during the scramble. Right now, a lot of smart people are working on work that really doesn't need to happen now. Things like fancy higher assurance hardware enabled governance mechanisms, cryptographic proof of training schemes, mutual verification architectures, etc. likely can be done after phase 1 is underway and done with significantly more resources. The scramble is not going to wait for fancy mechanisms and the government won't trust them on day 1 anyway.
These can largely wait for the phase 1 interim deal, resource explosion and the exchange rate on doing them early is poor. Heading. What ought we do? On Tuesday, October 16, 1962, National Security Advisor McGeorge Bundy knocked on President Kennedy's bedroom door at 8.45 in the morning. Kennedy was still in his pajamas reading the newspaper. Bundy had photographs showing Soviet nuclear missile sites going up 90 miles from Florida. Kennedy kept his morning schedule anyway. He met the astronaut Wally Skirra and walked the Skirra kids out to see Caroline's ponies. But then just before noon he sat down in the cabinet room with 15 advisors and started working the problem. Bomb Cuba, invade Cuba or blockade it while negotiating a way out. We may be in a similar situation soon. What would we do? Instead of fancy mechanisms we will go to the scramble with the verification you have. Spies, satellites, inspectors,
export data, not the verification we wish we had. Work that would be deployable and trustable during the scramble. At station stacks, supply chain computer counting, thermal and satellite monitoring, inspection protocols is what we need more focus on. And we also need significantly more focus on things that are less technical but nonetheless also important and neglected. Thoughts about BATNAs, genuine beliefs about loss of control, China policy, arms control experience, deal making mechanics. I recommend. Grand Challenge prizes for scramble relevant work. The verification community is small and relatively homogenous. There are individuals, organisations and companies with vast experience in hardware design, intelligence, non-proliferation, China policy and crisis management who have never touched this problem. Philanthropists could issue grand challenge prizes. And consistent with the sequencing argument above, the prizes should target ready-to-go monitoring and verification tools and
scramble preparation, not speculative higher assurance architectures. The OpenAI Foundation and the Anthropic Institute are especially well positioned to support this as they have the power and reputation to send a strong demand signal that attracts new talent. Mapping the existing toolkit. Assume the government needs a few months before it can understand or trust any sophisticated compute verification approach. What should it do immediately? How can standard intelligence services, geoint and ozent data, inspections and other familiar tools be useful during the scramble? What gaps exist and are their ways to close them in advance? Prepare the memo for the emergency White House meeting. Help ants are some of the questions above. What should we tell the president? Heading. Getting to a good scramble. The difference between a good scramble and a bad one is largely a function of what already exists when it starts. And right now, not much does. If you're one of the 100 odd people currently
thinking seriously about Frontier AI verification, the highest leverage question isn't what would the ideal world look like? It's what can we actually put on the table soon? There's rarely been a better time for those who have spent a career in intelligence, non-proliferation, arms control, or crisis management to start working on this problem. Everything after the scramble will be better resourced than everything before it, which is exactly why the work done before it counts for more. Let's make sure it counts. Heading. Footnotes. This section is omitted from the narration. This article was narrated by Type 3 audio for the Effective Altruism Forum. It was published on September 7th, 2026. The original text contained one footnote which was omitted from the narration. Images are included in the podcast episode description.
More episodes
More from EA Forum Podcast (All audio)

“Should You Start a Nonprofit or Join One?” by SofiaBalderson, High Impact Profe...
EA Forum Podcast (All audio)

“Regional EA groups should be incubators, not communities. Hot takes on EA commu...
EA Forum Podcast (All audio)

“Updates from the Swarm” by phoebe b
EA Forum Podcast (All audio)

“Do AI safety talent programmes work? Nobody has run the study that would tell u...
EA Forum Podcast (All audio)