MLOps Community
timezone
+00:00 GMT
Sign in or Join the community to continue

Airflow Sucks for MLOps

Posted Jan 17, 2023 | Views 700
Share
SPEAKERS
Stephen Bailey
Stephen Bailey
Stephen Bailey
Data Engineer @ Whatnot

Stephen has worked as a data scientist, analyst, manager, and engineer, and loves all the domains equally. He currently works at Whatnot, a collectibles marketplace that focuses on live shopping, and has previously worked in privacy tech at Immuta. He has his Ph.D. from Vanderbilt University in educational cognitive neuroscience, but it has yet to help him understand why his three children are so crazy.

+ Read More

Stephen has worked as a data scientist, analyst, manager, and engineer, and loves all the domains equally. He currently works at Whatnot, a collectibles marketplace that focuses on live shopping, and has previously worked in privacy tech at Immuta. He has his Ph.D. from Vanderbilt University in educational cognitive neuroscience, but it has yet to help him understand why his three children are so crazy.

+ Read More
Demetrios Brinkmann
Demetrios Brinkmann
Demetrios Brinkmann
Chief Happiness Engineer @ MLOps Community

At the moment Demetrios is immersing himself in Machine Learning by interviewing experts from around the world in the weekly MLOps.community meetups. Demetrios is constantly learning and engaging in new activities to get uncomfortable and learn from his mistakes. He tries to bring creativity into every aspect of his life, whether that be analyzing the best paths forward, overcoming obstacles, or building lego houses with his daughter.

+ Read More

At the moment Demetrios is immersing himself in Machine Learning by interviewing experts from around the world in the weekly MLOps.community meetups. Demetrios is constantly learning and engaging in new activities to get uncomfortable and learn from his mistakes. He tries to bring creativity into every aspect of his life, whether that be analyzing the best paths forward, overcoming obstacles, or building lego houses with his daughter.

+ Read More
Joe Reis
Joe Reis
Joe Reis
CEO/Co-Founder @ Ternary Data

Data Engineer and Architect. Recovering Data Scientist. 20 years in the data game.

+ Read More

Data Engineer and Architect. Recovering Data Scientist. 20 years in the data game.

+ Read More
SUMMARY

Stephen discusses his experience working with data platforms, particularly the challenges of training and sharing knowledge among different stakeholders. This talk highlights the importance of having clear priorities and a sense of practicality and mentions the use of modular job design and data classification to make it easier for end users to understand which data to use.

Stephen also mentions the importance of being able to move quickly and not getting bogged down in the quest for perfection. We recommend Stephen's blog post "Airflow's Problem" for further reading.

+ Read More

Watch More

1:11:12
Posted Jul 21, 2022 | Views 651
# Airflow
# Orchestration
# ML Engineering
# Union
# UnionAI
49:24
Posted Oct 30, 2022 | Views 606
# Ad Platforms
# Advertising Optimization
# Design ML
# Promoted.ai
57:22
Posted Jun 16, 2021 | Views 557
# Machine Learning
# Innovation