Anthropic's Insights on AI Risks and OpenAI Updates

0:00Welcome to the podcast. There is so much happening in tech and AI news today. I'll try to get you the most interesting stuff I've been scrolling through the comments on x finding some funny memes and takes on a lot of what's going on The thing I want to kick it off with because it just happened is that Apple has just released their brand new iPhone duo Which is like a folding iPhone and there's some cool AI features that are gonna be in there that I think a lot of people are Are gonna be interested in one of the things and they'll be rolling this out more broadly But this is gonna be with the iPhone 18 is that Apple has something called reference image features And this is to help basically fight AI fakes. I'll get into all of that on the podcast today Open AI has added something called sketch 2.5 to the new chat gpt image 2.5 so they have a new image model that came out and they have a cool feature called sketch I was testing it out today Open AI also claims that they have solved Navier stokes This is you know, there's like a million dollar prize for this math problem There's a lot of drama in here. I don't even want to get into all of it But it's kind of hilarious to me and Thropic had a researcher named Jacob Coxton who quit went viral on x this morning

1:06I saw he had over 400,000 likes on his post saying he quit and Thropic because I he believed that the AI model was going to kill Everyone in the world or had the potential to kill all of humanity. So this to say the least had even more drama in it We also have sooner that just released v.6 their model It was all trained on licensed music because they have so many copyright suits more drama there guys I'm not joking. This is just a wild day for tech We also have a bunch of hackers that are draining cloud subscribers token allowances because they're basically getting your Password and they're just draining all of your tokens from your account We also have meta that has launched a muse which is a personal AI agent built on a security first pitch I signed up for it today and I'm not going to lie I'm kind of excited for meta. I think that they're they're pulling out some interesting new technology And I'm excited for all of that I also wanted to mention if you haven't already if you'd like to access to over 90 of the top AI models in the world You need to go check out aibox.ai. That's my own startup

2:07We have an mcp connector. So basically it's a connector that lets every single AI model in the world work inside of any other AI model all of these AI companies notoriously hate each other You have sam ultman and adario you know at the big summit in India and everyone's holding hands and bowing because it's a big tech summit And they're another you know another person's country and they refuse to hold hands these people hate each other Elon and sam ultman to say the least also hate each other So if you they're never going to work with each other They're never going to let their models work with each other But if you want to have all of the different AI models working together go check out the AI box mcp That lets you know we have the brand new image model coming out of chat gpt You're going to be able to use that to generate images inside of cloud or if you have something like 11 labs that you use for generating audio you can generate all of that inside of the cloud Especially for something like cloud, which is a pretty good model But it doesn't do any of the image audio video generations or even opening I that's killing their Sora video model if you want to generate videos inside of Opening-eye work you can go and get google v03 to generate them So anyways all the models work together

3:08It's only it's less than nine dollars a month to get started And we have a bunch of tiers where you can get access to a ton of really cool stuff AI box AI linked in the description Okay, let's talk about apple first because I think this is an interesting tool that they've rolled out to kind of fight against Fakes apple just announced on the called reference images They have kind of this is tied to their iphone 18 pro launch Basically what it's going to do is it is going to capture signed sensor data So the moment that you take a photo It's going to capture that it's going to route it through private cloud compute So apple's compute and it's going to produce an unalterable image Apple is adopting the synth id standard to help users detect AI generated or AI altered images This is something that I think opening-eye and google have also been working with the iphone 18 pro is going to have an 84 megapixel fusion Main camera featuring a variable aperture built from six laser cut blades each thinner than a human hair So apple you'll get we're gonna get into all the drama today

4:08There's like and tropics researcher says it's going to kill all of humanity open AI apparently is stealing everyone's math research And we have apple that just said hey look we made a better camera and it's going to be harder to deep-fake So apple doing pretty good right now reference image is also going to start inside of the inside of the photos app There's going to be an API coming for third party developers as well So other people are going to be able to use this as well, which is going to be interesting So we'll keep up with that and then I just have one meme to share if you're watching the video version of this because we do share this Someone posted a meme of the new apple folding the apple duo iPhone duo with the folding screen and basically there's a feature on it where It has the main screen that you can see and then there's a little screen on the back side of it as well It's kind of like there's two screens on this thing But the way selfies work with this is if you're taking a picture for someone They can actually see themselves on the back of the phone and they could tell you to adjust how you're taking the picture And someone said this is going to destroy relationships. It's over boyfriend's are cooked nukes from orbit toasted fried

5:11Basically because they're you know the boyfriend's taken a picture of the girlfriend And she's like telling him how to adjust the camera because she can see into like the selfie Screen on the front and so he's adjusting it and inevitably he is still going to take the picture wrong even with her telling him how to adjust it So anyways, that's pretty funny to me. So opening I has now added or has launched image 2.5 This is a really impressive model. I've been playing with it today one of the coolest features on here besides Okay, I'm just like the quick rundown on it is that I think they're going to start competing directly with canva They have these things called templates built into it So it's like if you generate a logo It's like you know has these pop-up sorts like do you want to jet do want to see what this looks like on a t-shirt on a mug on a hat There's like all these different templates and all these different styles and all these different posters and things You can generate and it gives you ideas. I think they're going straight after canva with all of this Okay, one of the cool features they rolled out though was called sketch and I was playing with it today Essentially what you do is you say just the at symbol say at sketch and once that happens there is a

6:13Little drop-add that comes up for me I went and like kind of doodled a little guy holding a microphone in a red chair with a purple background And I said you know generate Image of you know this I kind of explained what was in my image and it went ahead and generated an image Which was exactly like I had you know requested it's perfect the thing that I like about this is sometimes when you're doing a prompt I do I'll will admit I do like taking a reference image to all screenshot and image I like and say like make an image like this but it has that and this and I tell it like some of the some of the things that Should be changed on it This is really cool because you can just do do it if you don't have a screenshot But it's just an idea in your mind you can do that and opening I actually had some really good recommendations and examples of like when this would become really useful One thing that they showed is like if you just doodled like a picture of the garden in your backyard and or you know Maybe you're like I'm trying to like redo my garden And so you do like a doodle where you they had one where it was like you doodle the pool and you kind of doodled everything that you wanted to

7:13To be inside of your garden and then it was able to generate first of all it generated like a top down View of that specific garden. So it's like look This is what your garden could look like with like a pool and your umbrellas and all your stuff And then actually went and generated like a real realistic photo from like you know Just the perspective of someone standing there. So anyways if you had an idea and you do it all that out It could help you with all sorts of schematics and all sorts of angles of this photo generated all sorts of ways I love this feature. I think this is very cool. I think it's like Open-A-Eyes image generator is one of just the most sticky features It's why I never left opening eye I went to clawed for like six months heavy with clawed code and with clawed co-work And I never was able to get rid of my subscription to opening out because I always needed image generation done And so I think by investing in it adding new features and new models They're doing an incredible job like no hype opening eyes image generator in my opinion is the best I'm never I'm sorry. Go I've never been very impressed with nano banana I think there's a lot of hype around it. It never be open-A-Eyes in my opinion

8:16So now that they have this new model, they're just kind of doubling down there and You know good on them good work Okay, and throppy researcher named Jacob Coxton has quit and he warns that labs are quote gambling with our lives So Coxton spent three years on pre-training at open-A-Eyes and Anthropic and then he said that people building the tech privately Believe it could kill everyone by 2030. So you know count down. We have less than four years left to live before AI Pakes over now. I've actually seen some really interesting conspiracy theories about this particular post the main concept for all of them Is basically the same and that's that this is a pretty complex regulatory capture move where essentially you can Or essentially Anthropic or or someone is pain to have maybe he was sincere in his like leaving But it was his post was very quickly amplified. So this is basically someone that has zero followers zero You know like history posting on ex before today and as soon as he posted he immediately had a whole bunch of people that lead like AI

9:20Regulatory companies Retweeting him and reposting within like 20 minutes And so this kind of helped the post blow up get a lot of notoriety And so a lot of people are saying that it is you know just people amplifying it because they want to You know, they want to regulate AI into oblivion But in the conspiracy theory around one of the thing that someone said about this was before he ever made the post You went to the Wall Street Journal and had them right I believe like an article on op ed about this and After it launched then he tweeted so it was like coordinated and he's obviously working with the press So some people believe it's more sophisticated because it's kind of a you know quote unquote random He said this is his tweet which was kind of a threat But the first thing said the people building AI earnestly believe that it could kill all of us by the end of the decade This is not a marketing stunt if anything many executives and senior researchers will coach their phrasing in the press to sound sensible But I hear the same people express fear privately no other human activity poses this level of threat So in the oh yeah, and I guess the main tweet he said was I resigned from anthropic today

10:21I spent the last three years building or the last three years doing pre-training research at both open AI and a Theropic neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives more thoughts below Anyways, then he kind of goes on the list and he's like look like maybe anthropics sorted doing something But there's nothing that they're you know, they don't really have a plan for recursive superintelligence Self, you know self-improving and then I everyone's just saying that anthropic has the absolute worst PR strategy of all time But maybe it's maybe it's a genius. I don't know then Evan Hubinger who still currently works on Alignment science. He's the alignment science lead at anthropic. He Responded to Jacob's post and he said Jacob is correct here with an m- I don't know if he's using AI to To respond, but I mean I would guess yes, but maybe some people are mad at me saying that m-s are normal Anyways, he said Jacob is correct here. We really do earnestly believe AI could kill all humans exclamation point I personally think it is less than 10% within the next decade I believe anthropic is trying its best

11:21But we do not yet have a plan to solve alignment for super intelligences and are not clearly on track too Like okay awesome. So the guy in charge of this says yeah, I think it's you know less There's a you know some percent chance that within the next decade AI could kill all humans and anthropic is doing its best But we don't actually have a problem a plan to solve it So that was a pretty wild response someone below that said is this a sponsor tweet for that artificial film and anyways Yeah, there's a lot of a lot of drama going on to say the least about all of this most of the comments on Jacob's original post are Some version of not really taking him seriously if I'm Being honest and then there's a lot of people that just are sort of AI doomers that are hyping it up Anyways, a lot of people are screenshoting. I don't know if you remember But there was a moment where back in 2022 a guy named Blake Lehman said that Sist said that system has Perception of the ability to express thoughts and feelings equivalent to a human child It said Google engineer was put on leave after saying AI chat pot had become sentient

12:25So anyways if you guys all remember that that was kind of a wild moment from 2022 Feels like it was longer ago But some people are saying the kind of reminds them of that guy and some people are saying terminator wasn't a movie It was a prophetic documentary Honestly, this is pretty overhyped but he's at 620,000 likes right now So perhaps we are all on track to die in the next couple years pretty pretty wild claim Okay, Suno is launching their v6 model. I love Suno. I've used it a ton. It's a lot of fun And I've released a few albums with it some of which make me you know hundreds of dollars a month from AI Generative music my most famous one that I always tell people about is I have Relaxing piano music to help your cat fall asleep that album makes me $600 a month and it's just AI generated It's actually like AI generated. It's not slop. It's just relaxing piano music It sounds great. It's funny how I marketed it It did really well and a lot of people just add it to their playlist to play to their cat

13:26So cats apparently love AI Generative music and I'm not even apologizing because you know if they love it Now one thing that I'll say is the problem with that music and and everything else which Suno takes the full liability for so it's not my problem But Suno trained all of their previous models on licensed music They just trained in all the music that existed in the world and all of the record labels sued them You had Warner BMG believe Sony and Universal and so they decided to train their brand new model and by the way Here's like my very contrary intake that I think also a lot of people would be mad about Because this goes for Suno and basically everyone else they trained it on everything they got in trouble They made licensing deals with the distributors But in the meantime their their company and brand grew a ton Maybe they wouldn't find enough money or wouldn't be able to get permission before But they're brand grew a ton and now they were able to pay right because they've raised over $819 million they're able to pay off all of these fines They're able to pay for licensing and now they're able to train a model with actual licensed music now

14:28There's a lot of different takes on this I've been due I've been using AI music generators for like 10 plus years I think at this point yeah about 10 years and so way before Chattachipate ever came out there's been a bunch of music generator models I don't know what those early ones were using they weren't that great But someone that were okay they weren't horrible and it was pretty fun back in the day Anyways, but with this new model it's all licensed data I think that's fantastic This is what we've seen everyone else do you get a model you get it big you get some revenue Prove the concept and then you go pay everybody out should you have paid everyone out ahead of time Maybe but if the model wasn't proven it's kind of hard they wouldn't have had the money to do it So anyways, that's another argument this release is gonna happen in three tiers So they have v6 which is paid they have v6 wild which is paid and experimental and then they have v6 mini Which is free all of the older sooner models are gonna be retired and the reason is because the data licensing issue So you know has erased all of that money and they you know obviously have all these lawsuits going on This launch is on the same day or just one day after soon

15:29We'll admitted to training earlier models on YouTube videos So beyond just all the music they actually went to YouTube videos, which is a huge no-no But to be fair openly I never admitted to training so are their video model on YouTube Although I kind of wonder if that might maybe is partially why they shut it down But Miriam or audio which is questioned by the New York Times and ask point blank Did you train the opening eyes so our video model on YouTube? She kind of just like shied away from the topic and it was like one of those famously awkward moments where she didn't want to You know, didn't want to answer the question basically So we get the opening eye probably also did that okay Hackers are draining cloud subscriber token allowances with stolen sessions and through up it confirmed that Info-sealer malware is hijacking cloud code OAuth tokens one max user watched usage climb from 45% to 55% While doing no work and so he's like what's going on wire my tokens disappearing people are hacking in and just using tokens to do certain projects Andthropic confirmed this and there is a separate users that reported their usage jumping from 0 to 49% in 12 minutes

16:34After only a couple of prompts and a web search and through up it suspended the affected accounts They invalidated all the sessions and the issued a partial refund one user received 44 pounds Further 200 all our month subscription account support tracks Account support tracks total usage but not itemized usage meaning token theft could run undetected for months Right, it honestly reminds me of all of the people that were doing like music body infarms where they would steal a whole bunch of people's Spotify passwords they would just get them on the dark web because they're usually you could get a You know, whatever so they steal from the dark web They would log into a whole bunch of random people's Spotify accounts randomly and just play their own song over and over again And then they would log out and it was really hard to track and Spotify spent a lot of time and money and eventually kind of crack down on the whole scheme And I think a lot of people doing it illegally might have I went to prison or some I know different things depending on how nefarious All of the the body and and kind of fraud went but this reminds me a lot of that It's the same idea you you get maybe combo lists from the dark web

17:36You steal a whole bunch of people's a tech count tokens and passwords you log in just get a couple things done Or maybe if they have an API you log in use a few tokens and then you log out and To then you know, maybe they maybe they'll hardly notice now my last complaint of the day in regards to all of this Which has absolutely nothing to do with that because this was completely legal no one hacked me is that today I asked claw or I asked chat GPT asteris so they're you know GPT six model I put on the absolute highest usage tier right the highest thinking capability and I asked it to go and review my website and give me Some good ideas for some good ideas to you know Review and and make the branding and the visuals on my website better and over the course of two minutes that it worked for it burnt through 90 or I think actually 80% of all my tokens for the entire week So do not touch asterisks on the absolute ultra max tier with the night with a six foot pole

18:37That's my advice to the wise if you're worried about your token usage unless you're at the end of the week And you got to use it quick before it resets or you have one really big problem I don't know like I just I'm so blown away that in two minutes It could use 80% of my tokens. I'm super annoyed by that I'm in my chat GPT account and they do have a very cool feature which huge shout out to chat GPT4 For adding and by the way clad's got the same problem with clad though you basically get locked out of your account with chat GPT They say you are now using luma a faster model for simpler tasks Use your reset or buy a reset for 80 dollars to continue using the most advanced models or wait for it to reset after and then it has my reset date So basically they switch you on to like one of their most I don't know basic models You can get basic tasks done But personally I'm actually very happy about that because at least they're not completely shutting off my account Just yeah, switch me to one of the terrible models and it can sort of do some stuff for me if I have if I'm in a pinch I actually have a second Clod account that I'll probably be using for a lot of stuff in the meantime, but overall yeah

19:38Good good pros and cons to that. Okay, really quickly wrapping up We got to talk about what meta has launched a this is muse. It's a personal AI agent built on a security first pitch The super intelligence lab product ships on iOS and Android and WhatsApp It has striped checkout and a $300,000 bug bounty ceiling So if you go find bugs, they're actually paying you for it, which I think is Genius on their part the paid tier is for people that are paying $20 a month And they have a $100 a month tier and a free tier and of course all of those is usage based They said that you get about 130,000 dollars for a single user prompt injections So like they're just paying you to red team this thing if you can use it get it to do something bad They'll pay you $130,000 that's pretty awesome deal in my opinion Checkouts because the reason why they're doing this is because they're adding payments into it They partner with stripe they have checkouts that run through stripes the link single use card numbers one password and shop pay integrations Are all underway. They're working all all that so what all this means is that you can go to muse and say hey

20:42I need to go you know I want to eat Taco Bell for lunch go and order it for me and it has access to your stripe account It will go get everything ready. It'll have a pop up. That's like do you confirm spending $14 on this burrito and drink from Taco Bell You click yes and get shipped straight to your door with door dash I personally love this. I mean, it's a big bet. I know it's a gamble. I know it's risky I mean open AI and anthropic are not doing this direct stripe integration where it can buy stuff for you But I think number one is smart for stripe because they're gonna get some good volume here They're gonna prove this concept. It's almost like there's insurance because open AI is like offering a $130,000 For prompt injection so They're you know, I mean, that's a massive bounty program. They'll pay you a lot of money if you can hack this thing And so a lot of people try hack it. They'll solve a lot of problems and yeah They're gonna get access to be able to tell your AI model to go buy things for you And you got to approve it and give it permission Muses powered by Meta's in-house muse spark model and it's shipped by a meta super intelligence lab Which actually came about about a year ago. So I know some people have probably freaked out about this one

21:44I think it's kind of cool. I'm excited for it and we'll see how well metas Muse works. I tried signing up for it today and it went on log and I forgot through all the senate process It like kind of crashed on me and they said they're having really wild really like a ton of traffic on it right now And I think if if I was over on Next earlier today I think I saw that they had made a post that it was like number three in the app store or something like that So it's obviously going Going pretty crazy a lot of people are using it Thanks so much for tuning into the podcast guys Leave a rating or review if you wouldn't mind on the show if you haven't already on apple It helps the show a ton in the algorithm on Spotify as well I appreciate all the reviews I read them all go check out aibox.ai if you want to be able to work with all of the different AI models inside of all of the different AI tools that you already use with connector or there's one chat thread on chat Should be teed that you can talk to every AI model audio video image in the same thread switch between them all It's amazing go check it out. I'll see you guys all in the next episode