MLOps Community
timezone
+00:00 GMT
SIGN IN
Sign in or Join the community to continue

Declarative MLOps - Streamlining Model Serving on Kubernetes

Posted Apr 18, 2023 | Views 253
# Declarative MLOps
# Streamlining Model Serving
# Kubernetes
Share
SPEAKER
Rahul Parundekar
Rahul Parundekar
Rahul Parundekar
Founder @ A.I. Hero, Inc.

Rahul has 13+ years of experience building AI solutions and leading teams. He is passionate about building Artificial Intelligence (A.I.) solutions for improving the Human Experience. He is currently the founder of A.I. Hero - a platform to help you fix and enrich your data with ML. At AI Hero, he has also been a big proponent of declarative MLOps - using Kubernetes to operationalize the training and serving lifecycle of ML models and has published several tutorials on his Medium blog.

Before AI Hero, he was the Director of Data Science (ML Engineering) at Figure-Eight (acquired by Appen), a data annotation company, where he built out a data pipeline and ML model serving architecture serving 36 models (NLP, Computer Vision, Audio, etc.) and traffic of up to 1M predictions per day.

+ Read More

Rahul has 13+ years of experience building AI solutions and leading teams. He is passionate about building Artificial Intelligence (A.I.) solutions for improving the Human Experience. He is currently the founder of A.I. Hero - a platform to help you fix and enrich your data with ML. At AI Hero, he has also been a big proponent of declarative MLOps - using Kubernetes to operationalize the training and serving lifecycle of ML models and has published several tutorials on his Medium blog.

Before AI Hero, he was the Director of Data Science (ML Engineering) at Figure-Eight (acquired by Appen), a data annotation company, where he built out a data pipeline and ML model serving architecture serving 36 models (NLP, Computer Vision, Audio, etc.) and traffic of up to 1M predictions per day.

+ Read More
SUMMARY

Data Scientists prefer Jupyter Notebooks to experiment and train ML models. Serving these models in production can benefit from a more streamlined approach that can guarantee a repeatable, scalable, and high velocity. Kubernetes provides such an environment. And while third-party solutions for serving models make it easier, this talk demystifies how native K8s operators can be used to deploy models along with best practices for containerizing your own model, and CI/CD using GitOps.

+ Read More

Watch More

43:17
Posted Sep 30, 2022 | Views 580
# Databricks
# Deployment
# Real-time ML Models
48:13
Posted Mar 10, 2022 | Views 456
# Data Platform
# Building ML
# Kubernetes
45:20
Posted Aug 30, 2022 | Views 959
# DoorDash
# Leverage
# Core Infrastructures