Meta's New Model, Gemini 4, OpenAI Proposes AI Policy

0:00Welcome to the podcast. I'm your host, Jane Schaefer. Today, we have an absolutely packed lineup for the show. The biggest thing that I've been super excited about yesterday and thropic unveiled their hosted AI agents platform. It's their cloud platform. I've been playing around with it a ton. There's so much there. And I think this is a really big shift, basically up ending a lot of what open claw did. But there's some nuances. So we're going to get into that in addition, Meta just dropped their very first model that was built with Alexander Wang. Remember that's formerly the CEO of scale AI with a kind of acquired him in. We also have a research team at Tufts that figured out how to cut AI energy consumption by a factor of hundreds, which is definitely a big deal if you think about how much power these data centers are burning through. Eli Lilly just flipped the switch on what they're calling the most powerful AI human supercomputer in pharma over a thousand blackwell GPUs, which are aimed at cutting drug development timelines in half. Open AI published a set of policy proposals that include robot taxes and a four day work week, which is probably the most opening

1:02I think I've read in a while. And Google released Gemma 4, which is their latest open source model that's getting a lot of attention for what it can do relative to its size. I mean, basically, this is an edge model that you can put on devices. So a lot to cover in the show today. Before we get into that, I want to mention AI Box, which is a tool I use every single day at this point. If you haven't checked it out, it gives you access to over 80 AI models in one place. This is my own startup. So instead of paying for separate subscriptions to Claude, Chat Gbt, Gemini, and everything else for 11 labs for audio or tons of the image models, you get all of that on one platform for 899 a month. And we have annual plans to give you 20% off that it honestly pays for itself pretty fast when you're not stacking three or four different AI subscriptions. The link is in the description. If you want to try it out, you get access to every single top AI model in the world, basically all the best ones in one place. So you're not juggling tabs and juggling subscriptions. All right, let's get into the first story, which is Google Gemini. I want to talk about their new open source situation with Gemini for. So earlier this week, they have released Apache 2.0 license.

2:03And basically, this is their latest family of open models built specifically for reasoning and agent work flows. What I think is really interesting about Gemini for is what Google is calling, you know, the best intelligence per parameter ratio in any open model right now. Basically, you're getting the frontier level capabilities of what you'd expect out of something like Claude or Chat Gbt without needing a massive hardware setup, you know, something like llama for Maverick requires that huge hardware setup. And so they're basically getting around that. The model already has over 400 million downloads and the community has spun up over 100,000 variants, which I think just kind of tells you how quickly developers are adopting this. I think the significance is that it's less about kind of the benchmarks and it's more about the trend right. The gap between open source and closed source models is definitely shrinking. And I think that Gemini for is just another data point in that direction. If we want to get into kind of the licensing on this, the Apache 2.0 license is also really important because it means that companies can actually use this commercially without worrying about any sort of restrictive terms. I remember when llama first came out for a meta and

3:04they were like, look, it's like an open source model. And it's like, well, it's not really open source. It's just like, you know, open weight and like you can use it. But if you really want to use it for something commercially, you got to let us know. And there was like all this kind of, I don't know, it was very unclear. And I think meta is just getting right around this for anyone that's building agents are doing, you know, reasoning, heavy work on their infrastructures is probably the most capable option that you can run locally right now. And I think given everything that we're going to talk about with meta in a minute, the open source AI community really needs models like Gemini for to keep delivering. All right, let's talk about open AI. They just published a set of policy proposals this week, which they are outlining how they think wealth and work should be restructured and what they're calling the quote unquote intelligence age. Now, maybe this is a big marketing thing. It feels like, you know, open AI and a thropic, they have like these, these big huge, I don't know, visions for the future and how AGI is going to take over the world. And sometimes it feels like that's a bit of a, a bit of a marketing stunt. I think what's interesting, open AI is essentially saying, you know, AI is going to displace a lot of jobs. And here's how we think society should handle it. And they're kind

4:07of combining like traditional left leaning ideas like wealth redistribution with a very kind of market driven capitalistic framework. It's pretty deliberate. I think they're kind of attempting to position themselves as a responsible player in all of this. Now, whether any of this is actually going to have any sort of influence on policy, I think that's definitely a different question entirely. Tech companies publishing policy papers doesn't exactly have a strong track record for changing legislation. But I do think it matters that the company is building some of the most capable AI systems. And they're at least putting kind of a stake in the ground on the economic consequences. You know, there's a bunch of funny things in there, right? They're like, we should have like a four day work week. And it should be powered by AI productivity gains. And it's not the worst pitch in the world that I've ever heard. At the end of the day, though, I just don't know if it's going to get there. And personally, if I'm being 100% honest for my own experience, and I think a lot of people like myself, instead of doing four day work weeks, I'm now doing, you know, six day work weeks and 16 hours a day on cloud code and cloud co-work, because I can get so much done. But maybe at some point, the hype will die down and I'll

5:09return to a more reasonable cadence. I hope who knows, right? All right, Eli Lilly has inaugurated what they're calling lily pod this week. It basically, it's a beast. It's about 1000 Nvidia Blackwell Ultra GPUs and they're delivering over 9,000 peda-flops of AI performance. So it's basically the world's first Nvidia DGX super pod with DGX B300 systems. And it's the most powerful AI factory wholly owned by a pharmaceutical company, right? So of course, there's other AI companies that have more powerful systems right now. But for pharmaceutical companies, this is the most powerful one. I think the numbers that really were kind of shocking to me is that historically, even productive drug research teams can analyze about 2000 molecular ideas per target year. And because every experiment requires you know, physical synthesis and lab testing, Eli Lilly pod removes all of that bottleneck and they're creating what's essentially a computational dry lab. So they're doing this at a huge scale. Scientists can simulate and evaluate

6:12billions of molecular hypothesis in parallel before committing to physical experiments, right? So the AI is going to sort of simulate what happens when you merge these molecules together. And then it's like, look, these are the ones that look promising to actually try. So the goal is to cut the traditional 10 year drug development timeline about in half. That's what Eli Lilly is trying to do right now. Nvidia is kind of working on this. They've also invested up to a billion dollars over five years in an AI co-innovation lab in the Bay Area. To me, this is just a really big example of AI delivering really like legitimate tangible value, you know, not just in the tech industry. I think we talk a lot about like chat box or coding assistance. But using AI to find new medicines faster, that is an application that I think could actually change millions of lives if Eli pod delivers even half of what Lilly is promising in terms of kind of accelerating drug development. Then I think a lot of the downstream impacts on patients is huge. And of course, the profits for Eli Lilly are going to be massive. So they're going to be thrilled. And I'm just going to,

7:12I don't know, I don't like to be too pessimistic. Actually, I'm really stoked about AI and health care. And I think there's a lot of benefit. Somehow I have no hope in pharmaceutical companies, because I feel like there's a lot of solutions that they don't talk about if it doesn't make them more money. So anyways, they're going to probably discover some awesome drugs that solve a lot of things and they're going to make a lot of money from it. So pessimistically, I don't know, it's, I guess, good and it's whatever. It is what it is. Okay, let's talk about neuro symbolic AI cutting energy used by 100 X. I think this is from a bunch of researchers at Tufts University. It's one of the biggest stories in this list. I think if you kind of look at this from a long-term perspective, the team, which is led by Matthews shoots at the School of Engineering, they essentially they built this neuro symbolic AI system. And it achieves a 95% success rate on structured manipulation tasks while using just 1% of the training energy that standard vision language action models require. Okay, I know that sounds like a big mouthful. Let me explain it. In the most

8:16simple terms, 100 times less energy and nearly triple the accuracy is what they've been able to achieve. So when they're, when they're training these systems, when they're using these AI, they're able to get outputs for 100 times less energy and the accuracy is tripled. Basically, the approach they took is merging some traditional neural networks with symbolic rule-based reasoning instead of kind of throwing these massive compute at pattern matching. The system is kind of breaking the problem into a bunch of smaller logical steps and categories. And then they're going to, I mean, what's interesting though is this is basically a lot closer. I think how humans actually think through a problem, right? When you have a big problem, you think of one of the steps to like achieve that, you kind of break it down in your head. I mean, that's literally where the term break it down came from. And they're just teaching the AI model to do this in a more human way and surprise, surprise, it saves energy. Obviously, our brains are designed to not, you, you know, burn too much energy when we're trying to figure stuff out. I think this matters because US data centers and also AI workloads now consume more than 10% of the entire country's total electrical

9:18output. Like this is so much electricity. And I think that number is projected to double by 2030. So if neuro symbolic approaches can deliver this kind of efficiency gain across more domains, I think it's going to make a really big impact. Not just, you know, some people are like, oh, it's awesome for the environment. Yeah, it's also awesome for economics, right? If you could do this for 95 or 100 times, you know, more efficient, that saves you a ton of money for these companies. Or I put another way, it makes this AI way cheaper for the user to use, which I think is really awesome. Right now, it's still a proof of concept. So we're not going to see this into production models today. But the direction, I think of kind of where they're going with this is promising. And I think kind of the broader industry is going to pay close attention to this because if they're able to achieve this, like I mentioned, for, you know, the bottom line on all of these companies, it's going to be amazing. All right. Meta has just debuted Muse Spark. This is their first AI model that has come out under they have a new leadership Alexander Wang who came from scale AI when meta acquired it came over to meta. This is the first model that's been put out under him.

10:18They had a whole bunch of kind of reorganization as it felt like meta was falling behind. I mean, still feels like they're falling behind, but they had this huge reorganization. They brought him on as the CEO in June last year. They spent $14 billion to acquire scale AI and him. Well, they bought 49% a non voting stake in the company. So essentially, they kind of acquired it. But in any case, in terms of capability, Meta says that Muse Spark is competitive with the leading models from opening an anthropic and Google across a bunch of different things. It ranked fourth on the artificial analysis intelligence index with score of 52. It's really good at figuring out and understanding and medical reasoning, but it does not surpass that basically all the top models across the board. So it's, it's a good showing, right? Meta's like sort of in the races still, but I would say they're not really because, you know, when they're like, hey, we came up with a new model and it's number four out of like, like basically what's happening is every three months, what the top lab comes out with their newest model and it beats everyone in the benchmarks, and they can take a victory lap and say, I'm the best, right? And we saw this. It's not just,

11:21you know, anthropic and open AI and Google, like Grock is also in the mix too. So somewhere between those four models, they're constantly kind of beating each other. And so if meta comes out and is like, hey, look guys were number four, like what? Maybe they slightly better than Grock and behind open AI and anthropic and meta. It's just like, yes, they could get integrated into all of the meta kind of, you know, WhatsApp and Instagram and Facebook. They get some users from that, but it's not like anyone can be anyone's go to model. So yeah, I mean, I think they're, they're pushing forward, but it's not that impressive. What I do think is really interesting, though, is MuseSpark is a closed model. So this is a huge pivot for meta's kind of llama strategy, which they were really aggressively open source for years. Lama's one of the most important things to happen to the open source AI community. And I think now meta is going in the opposite direction. So the model's design and code isn't going to be made public. I think it tells us a couple of things. Number one, meta clearly believes that they need a competitive close model to keep up with open AI and anthropic kind of at the frontier. Because in the past when they were doing all the open source,

12:22they were like, look, our models are not quite as good, but it's open source and all sort of open. It's like open weights or whatever they were calling it. They're like, yeah, you can like run on your own computer and stuff. And that was cool. That did have a big draw. A lot of people that didn't want to have to pay to run these models were grabbing it or hosting it. And so that was cool. Now that they're going close source, I think they got to be a lot more, I mean, their model has to get a lot better. The open source strategy was really good for adoption and kind of developer goodwill, but it was not winning the race as far as the best company goes. Now there are other people working on open source. And I hope that open source models get, you know, continued to get pushed. Not every task that you need an AI model to do needs like the absolute greatest, you know, frontier model. You could, there's plenty of tasks for your sort of folders or files or searching for things or, you know, rewarding something and like, you don't need anything crazy. And so I think a lot of those open source models would be great. Would save compute and energy and all that. And so I hope that this still gets pushed forward. And I also hope that we continue to make really powerful, really good open source models. But we'll see where this goes. It feels like meta rate for now is kind of

13:25getting close source. And it's also kind of in a weird place in the industry, right? We have open AI who just came out today and was like, Hey, we have a model also that's just as good as anthropics, you know, doom model that can like hack, you could find vulnerabilities in every software platform. And so, you know, anthropics like we can't give this to the general public. We're giving it to a handful of people. And so open AI is like, look, we got one of those two. You also have to think like if meta was like, yeah, we have one too. And it's open source. And anyone can use it. Then everyone would be like, Oh, no, you know, China, Iran, Russia, they're going to take over the world with it. So I think at the end of the day, their argument is going to be that they got a close source this because the models are getting so big. It's too dangerous to have like an open source version. People were already making that claim years ago. I remember Elon Musk in like, what, 2014, 2024 or something was like, you know, we got to have like a six month break on releasing any new models because they're too good with like chat GPT4. And it's like, wow, how times have changed. Those models seem so archaic now. Anyways, it's, it's an interesting point, an interesting place. That's the argument they're

14:25going to make. But I'm sure in two years, we're going to look back at the models we had today and be like, Oh man, those things were so bad. Like, you can't just like talk to your phone and any software you could ever imagine gets built and you can go like, use it instantly. So I'm sure things will change a lot. Guys, thank you so much for tuning into the podcast today. If you enjoyed this episode, I would appreciate it to no end. If you could leave a rating or review any sort of comment you drop on Apple really helps the show to get found by more incredible people like yourself. On Spotify, you have to hit the about tab. You can drop some stars. It helps out a lot. And as always, make sure to try out AI box my own startup. There's a link in the description. You can access to over 80 models and our automation builder. It's 899 a month. Anyways, I'll catch you guys all in the next episode.