MLOps Community
+00:00 GMT
Sign in or Join the community to continue

Orchestrating Machine Learning Workflows with Prefect

Posted Mar 04, 2022 | Views 649
# Coding Workshop
# Presentation
# ML Orchestration
# Prefect
# Prefect.io
Share
speakers
avatar
Kevin Kho
Open Source Community Engineer @ Prefect

Kevin Kho is an Open Source Community Engineer at Prefect, an open-source workflow orchestration management system. Previously, he was a data scientist for four years working in the energy and HR spaces. Outside of work, he is a contributor for Fugue, an abstraction layer for Pandas, Spark, and Dask. He also organizes the Orlando Machine Learning and Data Science Meetup.

+ Read More
avatar
Demetrios Brinkmann
Chief Happiness Engineer @ MLOps Community

At the moment Demetrios is immersing himself in Machine Learning by interviewing experts from around the world in the weekly MLOps.community meetups. Demetrios is constantly learning and engaging in new activities to get uncomfortable and learn from his mistakes. He tries to bring creativity into every aspect of his life, whether that be analyzing the best paths forward, overcoming obstacles, or building lego houses with his daughter.

+ Read More
avatar
Ben Epstein
Founding Software Engineer @ Galileo

Ben was the machine learning lead for Splice Machine, leading the development of their MLOps platform and Feature Store. He is now a founding software engineer at Galileo (rungalileo.io) focused on building data discovery and data quality tooling for machine learning teams. Ben also works as an adjunct professor at Washington University in St. Louis teaching concepts in cloud computing and big data analytics.

+ Read More
SUMMARY

Prefect is a general-purpose workflow orchestration management system that enables users to build, run, and monitor data pipelines at scale.

In this talk, Kevin shows how to orchestrate a full ML hyperparameter grid search pipeline over a Dask cluster. Other tools included will be Pandera, Tune, and Evidently AI.

+ Read More

Watch More

Real-time Machine Learning with Chip Huyen
Posted Nov 22, 2022 | Views 1.6K
# Real-time Machine Learning
# Accountability
# MLOps Practice
# Claypot AI
# Claypot.ai
Scaling Machine Learning with Data Mesh
Posted Aug 16, 2022 | Views 1.2K
# Data Mesh
# Culture and Technology
# Integration
# Thoughtworks
Trustworthy Machine Learning
Posted Sep 20, 2022 | Views 1.3K
# Trustworthy ML
# IBM
# IBM Research