
Deploying Scalable Machine Learning Models for Long-Term Sustainability
About this episode
As machine learning models proliferate and become sophisticated, deploying them to the cloud becomes increasingly expensive. This challenge of optimizing the model also impacts the scale and requires the flexibility to move the models to different hardware like Graphic Processing Units (GPUs) or Central Processing Units (CPUs) to gain more advantage. The ability to accelerate the deployment of machine learning models to the cloud or edge at scale is shifting the way organizations build next-generation AI models and applications. And being able to optimize these models quickly to save costs and sustain them over time is moving to the forefront for many developers.
In this episode of The New Stack Makers podcast recorded at AWS re:Invent, Luis Ceze, co-founder and CEO of OctoML talks about how to optimize and deploy machine learning models on any hardware, cloud or edge devices.
Alex Williams, founder and publisher of The New Stack hosted this podcast.
Get every episode summarized
Each time The New Stack Podcast publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
More from The New Stack Podcast

How Microsoft is governing thousands of Kubernetes clusters without manual inter...
The New Stack Podcast

Why long-running AI agents break on HTTP and how Ably is fixing it
The New Stack Podcast

Why the Linux Foundation adopted MCP, with Jim Zemlin and Mazin Gilbert
The New Stack Podcast

Fresh data has us asking, does AI demand Kubernetes?
The New Stack Podcast