Episode 39: The Impact of Data Science on Data Orchestration
About this episode
One of the big promises of data science is its ability to combine multiple disparate datasets to produce value-creating insights. But this is only possible if you can get all those disparate datasets together, in the one location, to begin with. The has led to the rise of the data engineer and the data orchestration platform.
In this episode, Sandy Ryza joins Dr Genevieve Hayes to discuss the impact of the data scientist on the creation of the next generation of data orchestration tools.
Guest Bio
Sandy Ryza is a data scientist turned data engineer who is currently the lead engineer on the Dagster project, an open-source data orchestration platform used in MLOps, data science, IOT and analytics. He is also the co-author of Advanced Analytics with Spark.
Highlights
- Welcome to Value Driven Data Science (00:00)
- Introducing Sandy Ryza and his journey from data scientist to data engineer (01:30)
- Navigating the challenges of creating consistent data definitions within teams (05:11)
- The birth and development of Dagster (11:32)
- Dagster: A tool designed for data scientists (20:54)
- Final thoughts and advice for data scientists (37:29)
Links
- Connect with Sandy on LinkedIn
- Follow Sandy on X
- Dagster
- Connect with Genevieve on LinkedIn
- Be among the first to hear about the release of each new podcast episode by signing up HERE
Get every episode summarized
Each time Value Driven Data Science: Boost your impact. Earn what you’re worth. Rewrite your career algorithm. publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
More from Value Driven Data Science: Boost your impact. Earn what you’re worth. Rewrite your career algorithm.
Episode 100: What Data Science Value Really Means
Value Driven Data Science: Boost your impact. Earn what you’re worth. Rewrite your career algorithm.
Episode 99: [Value Boost] Preventing ML Bias Before it Becomes a Problem
Value Driven Data Science: Boost your impact. Earn what you’re worth. Rewrite your career algorithm.
Episode 98: Building Trust in AI Through Model Interpretability
Value Driven Data Science: Boost your impact. Earn what you’re worth. Rewrite your career algorithm.
Episode 97: [Value Boost] Mathematical Modelling as a Gateway to ML Success
Value Driven Data Science: Boost your impact. Earn what you’re worth. Rewrite your career algorithm.