Driving B2B AI Innovation

In this episode, Zachary Hanif, VP of AI, ML, and Data at Twilio, joins Amir to talk about the engine behind B2B AI innovation. From selecting the right tools to navigating the shift from POCs to production, Zachary offers an insider's look at how enterprises can thoughtfully and effectively integrate AI.

We unpack:

The danger of "boiling the ocean" with AI

Why chatbots aren’t always the right starting point

What makes an AI POC actually valuable

And why UX in the age of AI needs systems thinking

💬 “If you come into it with a technology and not a firm understanding of the problem, you're going to solve a problem that isn’t there — and at best, you'll just end up with a great tech demo.” – Zachary Hanif

🔑 Key Takeaways

Start with the use case, not the tool: Jumping in with LLMs without a clear business problem leads to superficial results.

UX in AI is different: You’re not just designing for humans—you're designing for a human-model-human interaction loop.

POCs must build trust: Especially with generative AI, proof-of-concepts must feel reliable and human-like to succeed.

AI increases surface area: Models introduce new attack surfaces and complexities. Security, observability, and model risk management are critical.

Think systems, not screens: LLMs change how users interact with software. This demands broader thinking from designers and PMs.

⏱️ Timestamped Highlights

00:00 – Intro to Zachary Hanif and Twilio's AI mission

02:05 – Why most companies are AI tool users, not tool makers

04:25 – The “chatbot temptation” and why it might not be the best starting point

06:00 – UX lessons from Google’s early search box vs. today’s LLMs

08:30 – Why we’re still early in discovering transformative AI use cases

11:55 – How AI changes what a good POC looks like

14:59 – Should AI UX be its own discipline?

18:23 – How to know when a POC is ready for production

22:12 – Dealing with AI’s expanding “surface area” and model drift

25:56 – Why model risk management matters more than ever