Prefect is a general-purpose workflow orchestration management system that enables users to build, run, and monitor data pipelines at scale.
In this talk, Kevin shows how to orchestrate a full ML hyperparameter grid search pipeline over a Dask cluster. Other tools included will be Pandera, Tune, and Evidently AI.