How Open-Source is Reshaping the AI Infrastructure Stack

Aaron interviews David Aronchick, CEO @ Expanso (former PM lead for Kubernetes, Kubeflow co-founder, and open-source ML leader at Azure) about how open source is reshaping the AI infrastructure stack. Aronchick recounts his path from early Linux and enterprise work to launching Kubernetes and GKE, then creating Kubeflow in 2017 to orchestrate end-to-end ML workflows on Kubernetes. The discussion centers on gaps in AI infrastructure, especially reproducibility and determinism across hardware, drivers, OS, packages, and data lineage, arguing Kubernetes alone can’t fully solve it. They contrast open weights with true open-source models, noting that real openness would require reproducible training data and infrastructure. They explore “AI-native” enterprise architecture, the role of open-source harnesses/wrappers to add deterministic controls, and growing edge/distributed compute needs driven by governance, compliance, bandwidth, and hybrid deployment realities.

SHOW: 1061

SHOW TRANSCRIPT: The Enterprise AI Show #1061 Transcript

SHOW VIDEO: https://youtu.be/kpQg3YIIUL8

SHOW LINKS:

• Expanso homepage
• TechArena, "Expanso's David Aronchick on Data Gravity and Pipeline Debt": 
• Open at Intel podcast, "Data Privacy and Efficiency with Bacalhau Compute Over Data"

SHOW SPONSORS:

• NordLayer - Use ENTERPRISE10 for 10% off
• Nasuni - Activate your data for AI and request a demo

SHOW TOPICS:

You have a super interesting background (First managing PM for Kubernetes, Co-founded Kubeflow, led open-source ML at Microsoft Azure). Give everyone a brief introduction and how you became so involved in open-source and the Enterprise

OSS topics:

• Back when we were The Cloudcast, we covered K8s in depth, but I’m not sure we ever did a show on Kubeflow. Kubeflow tried to bring Kubernetes-style orchestration to ML workflows. Looking back, what did that generation of open-source AI infrastructure get right, and what did it miss that the current wave (agents, inference at the edge) is now having to solve for again? Oh, and maybe give a quick intro to Kubeflow as well for those that aren’t familiar
• Zooming out - open source shaped your whole career, from Kubernetes to Kubeflow to Bacalhau. Where do you think open source has the most leverage in the AI infrastructure stack right now, and where do you think it's losing ground to closed, vendor-controlled platforms?
• What are your thoughts on “OSS models”? Today, OSS really means open weights. Do you think there will ever be a truly OSS model? What would it take? Thoughts on the state of the industry?

A couple of Enterprise “grab bag” questions for you on a few different topics while we have you:

• "AI-native" gets used a lot and means different things to different people. What does AI-native actually mean for enterprise architecture in your view, and how is it different from just bolting AI onto an existing cloud or data stack?
• Regulatory and data residency pressure keeps coming up across industries (telecom, healthcare, financial services). How much of the edge/distributed compute push is being driven by AI performance needs versus governance and compliance requirements? Which one is the bigger driver right now?

CLOSING: If anyone is interested, what’s the best way to get started?

FEEDBACK?

• Email: show @ the enterprise ai show dot com
• Bluesky: @TheEntAIShow.bsky.social
• Twitter/X: @TheEntAIShow
• Instagram: @TheEntAIShow