Anthropic Joins AI Energy Alliance, Apple Launching Servers

0:00Welcome to the podcast. Today, I want to talk about a bunch of breakthroughs, AI news and buildouts when it comes to AI hardware. I think we've had a lot of talk lately about should we slow down AI? Should we not slow down AI? Pacing the frontier with Dario Amade. But the one thing that I think nobody is debating is the fact that this AI is going to need a lot of a lot of power generation, a lot of data centers, a lot of chips, and a lot of memory. And all of those things aren't something you could say, let's pace the development of because a data center might take 10 years to get a proper electrical hookup to it. These things, this infrastructure takes a very long time to get built out. The manufacturing facilities take a very long time. The planning that goes into it. So today, I want to talk about some of the areas that we're accelerating on and some of the big advancements we're seeing in the hardware side. The first one I want to talk about is that Apple is going to is basically bringing back a their server market, they're kind of back into the server market, they're going to do this in 2029 with their M8 Ultra and they're going to use Nvidia links.

1:02This is a market that they left and I'll talk a little bit about that. I also want to talk about the fact that SK Hi-Nex out of South Korea is in talks with Intel to make memory chips in the United States. If you have been following what's going on with AI, you know that memory is one of the massive biggest bottlenecks and there are only three companies that are currently doing this specific type of memory. At the same time, we have Nvidia Google, Emerald AI, which all launching something called the Alliance for Grid Flexible AI Data Centers. It's the AI Energy Management Alliance and there's actually 18 members. So Anthropic is part of it. National Grid is part of it, AES and our G. All of them are coming together to create an interconnected grid. There's some interesting statistics that go along with all of that. Now, if you're the kind of person that hates paying for subscriptions to all of those companies I just mentioned, like Google and Anthropic and Chat Gbt and everyone else, I'd love for you to check out my startup AIbox.ai. I give you access to over 90 of the top AI models. So you get Anthropic, you get Gemini, you get Claude, you get Grock,

2:07you get Deepseek, you get Proplex. So you get all of the top models, Image, Audio, Video, Every Top Model and Modality that you could want. There's 90 of them. It is $8.99 to get started and you use it by the token. So if you have a massive project, there's higher subscription tiers, but if you just want to test stuff out, you can chat with all of these different models in the same chat thread. And you can also connect them inside. So if you use Claude a lot and you want Claude to generate images, you use our MCP connector and inside of Claude, images can be generated by Chat Gbt or Video by Google V03 or whatever model you're working with. It is something that saves me so much time and I hope it's a super useful product. It is AIbox.ai, I'll leave a link in the description. Let's start with what was going on with Apple first. So this is 15 years after they killed X server. If you'll remember, Apple is looking to get back into servers and how they'll essentially put this together is they will have four MA Ultra chips and Nvidia's NV link fusion. And all of this is how they're going to be building out their new server, basically a

3:08new server offering. I think what's interesting here is we've seen a lot of Apple is basically one of the people that one of the companies that people have criticized heavily, they're like, oh my gosh, Apple's missing the AI boom. They're so slow. They're new Siri, the Apple intelligence, everything was so slow. And yet if you look at the stock price of Apple, it has not declined over this. They have actually made some incredible progress and it doesn't seem like the stock is declining. And one of the big reasons is because Apple, I don't know if it was accidentally or however you want to say it, but the hardware of Apple has been greatly used. And I think one of the big examples a lot of people will point to is when OpenClaw came out, basically everyone was running out to go by a whole stack of Mac minis that they were running OpenClaw agents on. Now, I think that Mac mini craze was kind of short lived. It was kind of a quick moment. Obviously, the Mac mini is just a great, a great product. And so I think a lot of people would just use it as a good computer. But I think they Apple did see a very real, very large explosion in sales because of that. And they've realized, hey, look, I mean,

4:12they're basically a little server on someone's desk. Why don't we bake actual servers for companies that are paying crazy amounts of money and this is something that's growing up as scaling up as companies are looking to have their own virtual machines. They want their own agents in the cloud. I think Apple caught the vision. They got probably a little taste of that. And so this is kind of the direction that they're they're moving towards again, this isn't going to happen till 2029. We know this because they said that this is going to be the they're going to have four M8 ultra chips. They just announced the M6 generation of chips in August. So the M8 line is at least two silicone cycles out. And so we know that the announcing it on the M8, it's going to probably be 2029. These servers are also going to probably incorporate Nvidia's NV link fusion. This is the same technology that Nvidia uses to stitch multiple chips into one logical unit. So they have their chips, but they're going to probably using Nvidia to stitch them all together. This is interesting because Apple is already kind of they had a pretty rocky relationship with Nvidia for a while, but they've

5:16turned back to Nvidia and turned back to their chips to help power the rebound series servers. So their relationship has been on the rocks for a while. It looks like they are defying that and getting back into it. And this is going to be a big part of what powers their new server offering. We have some big news out of South Korea. SK high necks is in talks with Intel to make memory chips in the United States. The South Korean memory giant would use Intel's US fabs for the first time. This is probably a big shift in where HBM is going for AI accelerators and where they're going to get built. The reason why this isn't interesting to me is because there's only three major companies that are building this specific type of memory. And by the way, SK high necks is what's making the memory that powers a lot of Nvidia's tech. So this is a major company. We have them. We have Samsung and then we have one other company out of Idaho that is building these specific memory chips. And so this is really kind of a global bottleneck. But I think they're seeing that there's all, you know, most of the demand is coming inside of the United States. Obviously China is going to have a lot of demand. But there's probably could be sanctions or I'm not sure what South Korea's

6:20situation is there. I think they see the demand coming out of the United States and they want to move closer to it. They're also making this the inter the interesting part is the relationship they have with Intel right now. Intel right now and Intel Foundry has basically been searching for an anchor customer to justify a massive US manufacturing buildout. They've been talking about this for a long time. We know that Intel stock was sliding and you know, kind of I don't want to say cratering. But Intel has struggled for a long time. It really should be one of the big companies we're talking about all the time. And we have the old CEO lead. We brought in new CEO and Intel's been on kind of a generational run for last little bit. They made a lot of partnerships with the United States government. And so it feels like Intel is kind of getting its mojo back and they're making a lot of moves. They recently announced a massive build out US manufacturing build out. And with that, they need customers. And so it looks like SK high nicks might be might be one of the big customers that's going to start building in their US fabrication facilities. This is all according to some reports by routers. This particular deal would be the first time SK high nicks produces memory in

7:22the United States. Traditionally, it's all been done in South Korea. SK high nicks is also basically the dominant supplier of high bandwidth memory to Nvidia's AI accelerators. So it's, you know, just kind of speeding up the supply chain on a lot of that. We also have Nvidia Google and Emerald AI, which are launching a alliance for what they're calling grid flexible AI data centers. This is called the AI energy management alliance. There's about 18 different companies that are inside of this. What's interesting with this, it was just launched this month and founders Emerald AI, Google and Nvidia are all estimating that flexible flexible data centers could unlock 100 gigawatts in the existing US grid. So what they're saying is that essentially the United States, the US power grid is only running at about 50% utilization on average. And I mean, you can imagine there's peak hours and sometimes on that happens in California, Texas, you hear about like blackouts or brownouts or, you know, and there's a big storm and there parts of the grid go down like there's all sorts of issues, but generally speaking on the average day, we're sitting at about 50% utilization is

8:28probably like peak hours in the evening time when everyone gets home and is charging their electric cars or, and you know, in the middle of the day when people wear work, it's lower in the middle of the night. It's off, right? So there's ups and downs in this, but it's on average about 50% utilization. Their thesis on this, there's actually something called Brattle Group. And they're estimating that each 10% gain in grid utilization is going to lower electrical rates by about 3.4%. So they're saying, look, we have the capacity to generate double the electricity. If we went from 50% to 60%, everyone's electrical costs would drop 3.4%. Because there'd be more abundance and electricity. And so it would just, I mean, I think it's a lot of it gets down to like peak usage times. You're not going to be paying peak prices. And so if there's just more electricity, there's more surplus, the peak, I guess, would be smaller. And so you'd save money. So that's their estimation. Nvidia digital reality and Emerald AI are going to switch on and they're about to switch on about 100 megawatt power flexible AI factory in Virginia later this year. So there's obviously something

9:31they're looking at getting power for these data centers and for a lot of these projects is an absolute nightmare. It's very tricky. Apparently, US data centers currently wait up to 10 years or more for a grid connection under some of the existing interconnection processes. And this is why you had Elon Musk when he stood up, he's meant this facility. He literally went and just purchased every portable diesel generator he could get and shipped it over to the facility. And instead plugging into the grid just powered the whole thing off of diesel generators, you know, much to the sugar and a whole bunch of lawsuits about like pollution and that kind of stuff. But this is how he got the data center up and spinning. And lest you think it's kind of random. I mean, that data center in particular, he's building much bigger projects, but that particular data center is making a billion dollars a month, about 900 million, a billion dollars a month, roughly renting their extra space, their extra compute to anthropics. So anthropics paying them a billion dollars a month. The only reason they can make that much money though is because they kind of threw this together in a, you know, in a sort of not traditional way. And so a lot of these

10:35data centers aren't looking to go and rent every portable generator. I think SpaceX or, I guess, SpaceX now, it was XAI at the time when they built this thing. I'm sure they've kind of they built in some more sustainable. I'm hoping they've built in some some more sustainable power generation methods. But at the end of the day, these things are very hard, very tricky. So the goal of this new alliance is to figure out how to plug into the grid and just increase the grid's utilization. The costs should come down for everyone, but they are also going to be able to plug in a lot of these big data center projects. It's a problem we're going to have to wrestle with. China is absolutely out accelerating us to an insane degree when it comes to power generation. And if we want to power all of the projects that are currently under construction, we need to solve this. So this appears to be the solution that is being looked at by many people. Guys, thank you so much for tuning into the podcast today. If you enjoyed this episode, make sure to go check out aibox.ai. Leave a rating and review on the show wherever you get your podcast. It helps this show out a ton. If you wouldn't mind and make sure to go check out aibox.ai. If you want to get all of the different AI models plugged into Chad chick T or Claude or wherever

11:39you do your work cursor, et cetera, you can get 90 different AI models plugged into that. So you can do audio, video, image generation all inside of the same all inside of the same workspace. Thanks so much for tuning into the podcast and I'll catch you guys all in the next episode.