GTC Bonus: Fully Encrypting AI Workloads with Pankaj Thapa of Mirror Security

0:00Welcome to reshaping workflows with Dell Pro Precision and Nvidia, where innovation meets real-world impact in high-performance computing. This Logan reshaping workflows, GTC 2026 Day 3, we are here with PanCache from Mirror Security in the Nvidia Inception area, which is my favorite, because these are the new companies doing things that have never been done, or maybe doing them better than they were done before. But PanCache, let's get started with, tell us a little bit about you, Mirror Security to start us off. Yeah, so I am the co-founder and CEO with Mirror Security. I take care of sales, partnerships, product management, and what Mirror does, we are basically solving one of the biggest challenges with AI, which is the data exposure risk. And basically, I mean, if you have to derive intelligence from these AI models, you will

1:04have to share the data. So regular industry, I mean, so the data is very close to their heart. So what we do is basically encrypt the complete AI workloads, your prompts, your contacts, your documents are all encrypted. And these models are able to do the operations and inferencing on the encrypted data itself. So we call this encrypted AI inference, and also we take care of the context memory. So encrypted AI memory. So those are the two major breakthrough capabilities we bring to the AI ecosystem. Okay. So I got a lot of questions, and like I said, maybe solving problems have never been done, because I've never really heard of this. So, okay, let me give you a hypothetical. I work at Dell, we have tons of data, and we like our stuff to kind of run locally. But at the end of the day, you're right, like exposing it to outside models, et cetera. And don't give away any IP or secrets here. I don't want that. But maybe walk me through like a workflow of where you fit. Like where do you fit in the workflow, like a rag chat application, for example. Yeah.

2:05So basically, we offer a SDK. So if you are building a rag application, right? So we are compatible with all the vector devices. You will use one of these AI stack to build your rag application. So using this SDK, when you are ingesting any documents. So it will be encrypted, and our technology enables encrypted semantic search. So that's the breakthrough, which means, so never in the pipeline, I mean, these documents sit in the encrypted space. So even if it is an air-gapped environment, so one of the biggest challenge is the ransomware attacks or the insider threat. So somebody can dump all your embeddings and reconstruct. Now people are using AI to basically attack your systems. So with 92% accuracy, they will be able, they are able to reconstruct your documents. So big threat. So even if it is an air-gapped environment, as you say. OK. So building your local application, you have your SDK. Well, let's say something, for example, that's not running locally. Most use cloud code. For example, how does mirror security work, or do you support something that might be inferencing in the cloud?

3:06How would you protect the code base, for example? Absolutely. Yeah, it's a good question, I mean. So one of the major workloads is, and the use cases are on the AI coding assistance, right? OK, we are compatible with all the open source models, like Lama, Mr. Alquan, I mean, so some of these are being used for the coding assistant. So there we provide end-to-end encryption. So we sit as an extension in some of these visual studios, which means, I mean, so as soon as your code, code base start getting indexed. So these are indexed in plain text and sent to the cloud. But with mirror, everything is encrypted before the indexing happens. And when you are generating the code, it is all into an encrypted. Now coming to, let's say, somebody's using GPT or somebody's in cloud. So we take them through the confidential computing route. I mean, that's where our gateway comes into the picture, right? So we ensure that your code, which is, again, some form of data, proprietary data, and it has to be protected. I mean, that's what we are going after. Yeah. Honestly, I've never heard of this before. I think it's actually fantastic.

4:07So let's say someone is out there, they're listening to the episode, where can they get one, connect with you, or where can they find more information on mirror security if they want to, you know, better understand what kind of your product, but how you can encrypt data to obviously keep, obviously, something that would be on the resident, right? So tell everyone where they can kind of find you. Yeah. Absolutely. So you can visit our website. I mean, so mirror security.io. I mean, so we have all the information you can connect with us. You can also follow us on LinkedIn. I mean, so mirror security. That's why I love the Invinianception Area GTC, because you get to hear problems. These are the companies that solve it. So it's fantastic. So with that, Logan, GTC, 2026, we'll see you on the next one. This podcast was produced in partnership with the Mays Media Labs.