Greg Brockman on Astra and the Future of OpenAI

0:00We have Greg Brockman, the co-founder and president of OpenAI with us. Welcome to the show, Greg. How are you doing? Doing great. Thank you for having me. Thanks for hopping on. Huge day. Can we start with the math advances? What is happening? Why is this important? There's a lot of back and forth in the timeline, but I'd love for you to just set the table for us on what actually happened with Navier Stokes today. Well, it's always a huge day in AI and modern phone digital progress, I would say. Today, we announced that our model had solved the Navier Stokes problem that we found a counter example or a proof that you can actually that these theoretical equations do have a singularity or kind of breakdown under certain circumstances. And this is a problem that has been open for a very long time. It's one of the seven millennium problems, which are kind of some of the deepest, most important problems of mathematics.

1:00I think that the problem itself is important. This is new knowledge for humanity. The proof itself is actually very elegant and beautiful. I think that there's a lot to learn from it. The equations have lots of application and fluid dynamics in other areas. But to me, what's even more important is about what this represents about where we are in terms of model capabilities. The fact that we can actually generate new knowledge that we can learn from these models to have them help us solve problems that are otherwise outside of reach or would take us very long to solve. Yeah, where should I actually go with this? Is this going to help me book a flight? Is this going to help me cure cancer? Is this just going to help you recruit researchers who are fascinated by this stuff? Because I think that there's this is taken over the technology world. But I imagine that this will not be something that gets talked about it. Backyard barbecues with friends and family that are three clicks removed from side of that. Outside of SF. Yeah. Yeah. Well, look, I think that there's first of all the applications of this specific result or the equations themselves,

2:02which are things that let us better understand phenomena from ocean currents to air flow around aircraft around turbulence and things like that. But it's really about the broader insights and methods that can help scientists and mathematicians further accelerate their research. And I think that again, representative of if we have models that can help solve this kind of problem, then I what happens from here? Like what other problems that are immediately applicable? And I think that talking about curing diseases and new medicines, we're going to be able to develop. All of that starts to become much more real when you have models that are at this level of assistance and capability. And I do think that there are going to be real changes to think about in terms of we can have so much more ambition with the kinds of challenges that we can hope to tackle now. Yeah. I mean, I think even if this doesn't break through to the broader world, the weekend definitely will, because it seemed like everyone was talking about blender,

3:04talking about astra, building stuff. Take us through the launch of astra, what the feedback has been, what you've learned. It seemed like there were a couple of resets, the models scaled very well. How was this launch different than previous launches? Well, first of all, I've just been blown away by the community new reaction to astra. It's been really amazing and very humbling honestly, to see all the creativity and the different ways that people have been applying the model. And I think it's very clear that we've reached a new threshold of computer use. So this model is able to, I really work with different kinds of applications in a way that was not previously possible. And people are taking full advantage of that fact and really thinking about how to create. I lots of people showing off 3D creations and mapping out physical locations and turning them into into these 3D models. And thinking about can you use this for design of physical parts? Someone talked about how they were designing some mechanics for catching hair in a shower drain. And they were able to supercore. They're now able to actually manufacture that.

4:10Shower hair super intelligence. No, that stuff's so mundane, but it's so important. I feel like a lot of this stuff gets lost. Exactly. And I think there's a core there that's very important, which is that we are talking about these grand challenges sometimes, or very esoteric applications. But really, every day, the number of problems that you have in your life that you would love to solve, it's now possible. We're really trying to empower the individual to make it so that you can be superpowers that you can accomplish more. And I think that really trying to benefit people, empower people, build tools that can really help you and help you in your daily life. That's all part of what we're working on. So yeah, I mean, it seems like a huge number of people in tech effectively rebuilt their entire house in Blender and planned a remodel this weekend. Thanks, Dastra. But I am wondering about the merge and how you bring together codex, chatchupt work, chatchupt on desktop. I have a gaming PC now with Nvidia card and I have Mac mini.

5:15Like, I have all these things. And I can imagine that I'm just, I'm doing that unnecessary or like, it's fun for me, but that early adopter work of going and unhobbling it a little bit here and there. But in the future, this will all just be tucked in one, you know, prompt box. And it might build a 3D Blender model for to answer my question of should I remodel my house or not. But how do you see the capabilities that we saw on display from sort of light power users over the weekend actually making their way into consumers who might not even know what Blender is? Well, I think you're exactly right that we really want to shift these tools from requiring kind of a global level sort of yeah, access or guidance to really having the human be able to fly right to really be empowered for you to be able to set the goals and the objectives. And that you still should feel like you can get into those details and you can understand them. You can provide that oversight because ultimately you should feel accountable for the outcomes.

6:17But you have this absolute amplifier, right? Like a trampoline or like a, you know, rocket ship for the mind, like however you want to to to analogize it. And I think what that means at a practical level. So first of all, this year we've been really seeing this shift from just pure chat use cases through genetic use cases. But I would also keep in mind that chat is alive and well. I mean, we're now well over a billion users every week that you can see that the market share of chat, you be able to start a high once again because we've been investing so hard in so many use cases that are important for people and education and health and a variety of other areas. And then at the same time, these productivity deep knowledge work use cases, those are really taking off. We've had this like almost vertical wall of a genetic adoption since we launched chat, GPT work. And I think that the fact that these are two distinct modes that that is actually a point in time. That is something we're continuing to unify and merge. And that we're starting to see that there's a new emerging form factor for how people want to consume AI. And I think that it's almost like that the promise of AI has always been that you have something that you can talk to

7:21and really delegate work to that's proactive and persistent. And that I what we were promised, if you were going to rewind five, 10 years ago, is never a global language model that you have to think about context windows and you have to select thinking, strengthen, you have to select different models like none of that. None of that is the future. And so I think that we're moving towards real amplification, real giving you time back, real having computers that are able to operate according to your goals, to your desires. And I think that that is a core of it. We're developing this safely. That's that's one of the core commitments that we make and how we think about this. But we really see the power of these tools starting to really really start to increase in terms of what people are capable of. And that under the hood, utilizing tools like blender so that that is almost the detail that fades into the background is absolutely the direction of travel. It feels like in AI particularly there's been a almost like a first mover disadvantage in that

8:21billions of people have tried chat GBT and some percentage of them tried it for the first time and have a certain impression of the product and what it can do. And then, you know, even in the last few weeks there's been new agents and products that come online and people try it and their mind is just completely blown. And I think it's funny because I'm like, well, as somebody who's like, you know, trying to get the absolute max out of chat GBT, I'm like, well, I've been running like, you know, I've had like an agent running that, for example, will tell me every time a space hex launch is going to happen and if it gets delayed, right? These sort of like persistent agents that are running the background. And but but strategically, I feel like it's a new kind of challenge because you have this as capability has been been scaling. First movers need to be almost like constantly reminding the market of all these just like new ways to use. Yeah, we think about this a lot. And I think that there's this discovery problem that we as a field need to really encounter in

9:22a first class way. And we haven't done it fully yet. But I think we have a real shot at solving it better than any products before because the the thing that that right now we kind of rely on you think about chat GBT, chat, you know, you work these are both text boxes, right? And it's like, well, this new text box is way more powerful than the old text box. And but oh, there are some reasons that you still want to use the old text box. It's like hard to confuse me. People just want something that can help them solve their problem. The whole point is to get your time back, not for you to have to go and become an expert in all these these internal details. But at the same time, we also have a model that understands what you're trying to accomplish, right? That you're explaining to it. Here's what I want. It has a lot of context on you. And so it should also be able to practically say to you, hey, actually, if you ask me this other way or if you added added this connector or if you authorized me to do this or if you, you know, hook up your credentials in this in this way, I can go and do this other thing for you. And so we're thinking a lot about that self knowledge, that onboarding process. And I think that is a huge huge opportunity. And I think

10:24that there is both the disadvantage that you cite of people tried it. They form an impression and it's changed. That it's something new. But there's also an advantage. I mean, chat, chat, CBT, like over a billion users every week, like that is unique. No one has that kind of use on on these models. And I think that the number of people who have tried chat, CBT before, I think it's another, you know, billion, billion and a half something like that. And so that's a huge opportunity as well for us to go back to those users and say, hey, we can now solve the problem for you. We can now help you in ways that you didn't see before. And I think that it's true. It's real. If you look at how many people use chat for health, 300 million people every single week with health queries, right? And that that's really making a difference in people's lives and that of their loved ones. And so we have such opportunity. Yeah. One thing you say with health and explain where these goes. One note before that, something that I think is really interesting. And I think something that open AI can do a lot better is like when people talk about like everyone in AI wants to be like the Apple of AI from a marketing standpoint. And when they when you think like Apple marketing,

11:26you're thinking like Mac versus PC or you think in 1984, these big branding campaigns. But the actual thing that Apple does really, really well with marketing is they just hammer really, really specific details about their products, right? They're like, they're advertising the new camera. They're advertising emoji, right? They're advertising like certain features and so far right? And so it's like, with AI, the service area of like things that you need to communicate is actually like an order of magnitude greater because they can do so many different things. And so I think that it's such an opportunity for the company to focus advertising. The brand campaigns are awesome. And like the launch video for Astro was amazing. But it's like, there should be billboards running of like very specific things that chat should be teak and do to give you back your time. Yes. This is actually been a real sort of realization or just like something that I have really come to over the course of of this year. And if you look at even for example, the you know, we just announced chat, CBT images 2.5. And if you look at the launch video there, the thing that I love about it

12:29is it shows here's someone creating an image and here's like a bunch of different variations of it. And then here's them taking their favorite one and having it in the world. Like someone said, here's a cool like little sketch of a candle holder. You see an awesome visualization of it. And then you see the physical candle holder and you're just like, that's what you want, right? It's like it speaks to you immediately. And I think that really showing people here's a use case. And the thing that was also a little surprising to me is that we've sometimes highlighted esoteric use cases, something that appeals to someone in particular. And it's amazing for that person. But people don't then say, oh, because it's this powerful, I can also do this other powerful thing I've been waiting on. Like that connection is something that is less sort of easy to make than I'd realize. And it makes sense. What you want is for there to be use case where people say, I actually want that particular thing. Now let me go try it myself. And then from there you start exploring and you start to find, I actually do have this powerful use case that I didn't even realize was tip of the time. Yeah, the other thing was probably like the best example of that working really,

13:30really well. The other thing is is reminding people to ask the AI what it's capable of. Oh, yeah. Like I was I was having lunch with a buddy who's a real estate developer and he is using chat all day long for different like deal memos and to understand like projects that he's working on all this stuff. And he'll ask me, he'll ask me all the time, can can chat you could do this or that. And I'm like, I'm happy to answer you. But like you have the thing that we'll just explain exactly how to do the thing that you want to do or or maybe not, probably can't. Yeah, I did the same thing. I was kicking out this blender thing and I was like, should I run this as a local codex thread or in the cloud, let me know which ones better based on my system and it gave me good answer. I was able to go for one. On images, when images two came out, I had some moments where I thought, okay, images is solved. Yeah. Like where do you where do you think images actually go as a category? Because it felt like this has been something that has maybe one shot me more than anything else. Specifically with like when it released, I was spending hours like on a Saturday trying to design furniture,

14:38right? And just going through like hundreds and hundreds of prompts. But how far can image models go and where are they going and what are the ways in which you think they can they can be applied? We were talking earlier too about the downstream impact of image models. If you can take a physical space somewhere and take a picture of it and imagine it as all these other variations, there's so much like real world activity that will be driven from that because people can see this thing visually and say like, now I want to go make that reality, which I think is really cool. Well, I think that's exactly the right way to think about it. As you hit new thresholds of capability, my experience has always been that fundamentally new applications become unlocked in ways that you almost wouldn't have thought about ahead of time. And so I think that within, for example, knowledge work, professional work, marketing, all those areas, you just need to be above a quality threshold. If you're below it, it's a cool concept, but you can actually use the final material, right? That that then means that you haven't really solved the problem and that

15:39having precise edit control being fast and really being creative and having diversity of different results and also being able to have this good interplay back and forth with the person, I think that that really unlocks only use cases. And I think there's a huge market there. And even for example, the kinds of things you may not think of naively, but actually start to be really important applications we're seeing happening is slide creation or making awesome websites, right? Being able to have that image generation capability in the middle is something that's very unique to open AI relative to some of our competitors. And I think that you're able to then produce much better artifacts downstream. And so we really view images, we view voice, we view coding, all of these capabilities as one package that are going to come together to create an AI that empowers you that means you can create anything that you imagine. And I think it's going to be something that's just unlike anything out there. Let's go back to health. I think most people

16:39already are aware that you can synthesize some lab data with some sleep scores, but your vision that you laid out recently for where that product goes is much more complex, much deeper. So tell me where Chattu B.D. Health is going in the future. Well, I would think of it as there are three sides to what we do on health. There's the consumer side, again, 300 million people every week with health queries. There's the clinician side, which is bottoms up. And that's really about thinking about a Chattu B.D. that's really tune for clinicians that gives them direct citations to medical literature, things like that. There's a third pillar, which is the enterprise side of selling directly to hospitals and them enabling it. And you can see things like we have an integration with an epic and really trying to bring each of these three pillars the best possible service independently. But you think about as those really build momentum, that you actually are able to get synergies across them, that there's something that actually makes

17:42the health experience and the ability to really transform health care in America and the world on the table. Because there's so many, I think about how much work you as a patient have to do if you're talking to different specialists, you have to carry your medical record from one to the other, you have to explain again, here's the issue, and that ultimately you're on the hook, you're the doctor who has to make the decision whether you like it or not. And actually being able to have just good sharing of that information across different providers, that becomes possible if everyone's on one platform. Or think about clinical trial enrollment. That's a huge bottleneck to drug development and finding people who are eligible and will benefit from being enrolled in a particular trial. And if you have that kind of of data, if people are willing to sort of trust you with that information, that that's something that actually really benefit them and benefit the world at the same time. And so what I view us as building is really trying to build the world's best health care platform to really be able to bring health care into the AI age. And I think that it's something that is going to be absolutely transformative to many people's quality of life really uplift

18:42so many people. And we're seeing it already in such concrete ways. Some of my favorite stories about chat GPT are people who say, Hey, information I got from chat helped me save my own life, helped me save that of a loved one. That there was this medical issue that someone had and that, if you know, Dr told me one thing, I was able to double check that and understand what they were saying and be able to push back on it and got to a good outcome. And that happens every single day. So I think that health with these AI is something that we're sort of scratching the surface of what's possible. And I think it's one of the most positive applications of AI that you can think of. Yeah, I'm very interested to see how the advancements in memory intersect with health because I expect that chat GPT with where memory is gone, where I'll be in a new thread and it will bring up just the right information or tie back to a thread that maybe happened three weeks ago. When you actually apply that to like health related queries, it may be able to like pick up patterns that sometimes would take a human years to figure out like a certain ailment or something

19:45like that where it's like, hey, you're asking about all these different things and maybe you thought they were not connected, turns out they actually are and you should go down this sort of like rabbit hole. Last question. I think, I was going to say I think that's absolutely right. We're seeing that very concretely and we've seen, you know, just in my own personal life, my wife, you know, we talked about some for medical conditions publicly, but it was really this five year journey of talking to many specialists, each one who was kind of touching one part of the elephant and would try to address that one heart and it was only finally her allergist who said, hey, I think all these symptoms you're seeing are connected and you have this genetic condition that affects all of your subsystems and that's the kind of thing where it's really hard to say how many people have similar kinds of conditions and just never find out. How many people have these areas where it's like if you just sort of are functionally specialized that you're never going to bring together the whole diagnosis. And I think that is one of the powers and potentials of an AI that really deeply is able to help you across all parts of your

20:47life and also is a deep domain expert in all areas of medicine. Yeah. I have one last question. What, how do you tell the story of operator? It feels like it was a failure or a side quest, but it feels incredibly important now given the advances in computer use. Is there a clear lineage there? What was operator? Does that still exist somewhere within chat GPT? How did computer use get solved? Yeah. Well, look, I would look at all these things as timing and all about iterative deployment. Right? There's a moment where you need to, where the capabilities aren't quite there, but actually learning from real world deployment is very helpful. Right. And I think operator was just kind of below threshold in terms of the model capability. It was a Cod-based system that operated with computer use slow. It wasn't fully accurate. It was like pretty painful to use. Some people got value, but it really wasn't above threshold. And if you look at what's happened, the team, like one thing OpenAI does very well is we make long-term

21:51investments on things that really matter and we do the grind. And the team this year, I think, really started to build momentum that we put in a lot of effort to go and sort of burn down along list of issues. We're able to really focus on solving computer use. And I think that they deliver it in a significant way. And there's more to do never done all those things, but it's a true milestone. I think people are really appreciating what's possible because we've been in a world with these agents using computers through connectors, right? Through these very painstakingly coded systems that are so different from how humans use computers, whereas humans can already use everything on a computer, right? Everything's designed for people. So if you have an AI that can operate that way and even from the very beginning of OpenAI, we had a dream that one day we could create such an AI, it becomes able to help you across everything that you would be able to do with a computer yourself. And so I think we're there with Astra. I think that there's just so much more that people are going to uncover in terms of applications where this can go, but it's an example of long-term focus,

22:52viewing the work and not giving up even when the go-and-get stuff. Yeah, and it feels like Astra, my view is it really felt like all these different bets coming together at the right time, right? The advancements in the model itself, the computer use, voice, all these things, and it's all making sense. The things together, it's focused. It's something that I think this company does extremely well when we really put a challenge in front of us and think about how to accomplish it safely well and to really deliver the value we're doing. Yeah, put differently. It felt like when you look at last year, it felt like OpenAI was operating like a big company, and it was a big company, but the way in which product experimentation was happening was when you think of a hyper-scale, they'll launch a new product thinking, okay, if there's a 20% hit rate or even a 10% or a 5% chance, and then this year it feels like actually the entire company switched back into actual startup

23:54mode, which is like, no, focus, focus, focus, all these things need to come together. The whole team needs to be rowing in the same direction, and then the difference in momentum and growth and all these things coming from that, and actually taking the company from operating and shipping, more like a big company to shipping again, and focusing like a startup has been, feels like an impossible task and it's been incredible to watch. Yeah, that's. Thank you. No, it's been a real, real effort from many, many people at OpenAI to really bring together and something that I really value that I think we really value as a company, and I think that we're just so laser focused on our mission and really think about every piece of what we do should add up to helping us accomplish it. Well, thank you so much for taking the time to come chat with us. Great to see you. We'll talk to you soon, great. Thank you. Talk to you next Tuesday. Bye.