technologyAug 29, 202442:14pending
Metrics Driven Development (Practical AI #284)
About this episode
How do you systematically measure, optimize, and improve the performance of LLM applications (like those powered by RAG or tool use)? Ragas is an open source effort that has been trying to answer this question comprehensively, and they are promoting a "Metrics Driven Development" approach. Shahul from Ragas joins us to discuss Ragas in this episode, and we dig into specific metrics, the difference between benchmarking models and evaluating LLM apps, generating synthetic test data and more.
Get every episode summarized
Each time Changelog Master Feed publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
More from Changelog Master Feed
Forking Cal.com to closed source (Changelog Interviews #685)
Changelog Master Feed
Sep 3, 20261:54:32pending
Postgres at PlanetScale (Changelog Interviews #684)
Changelog Master Feed
Aug 25, 20261:42:17pending
Canary tokens and digital tripwires (Changelog Interviews #683)
Changelog Master Feed
Jul 21, 20262:06:48pending
From open source hits to OpenAI (Changelog Interviews #682)
Changelog Master Feed
Jun 5, 20261:46:28pending