MLOps Community
+00:00 GMT
Sign in or Join the community to continue

Declarative MLOps - Streamlining Model Serving on Kubernetes

Posted Apr 18, 2023 | Views 759
# Declarative MLOps
# Streamlining Model Serving
# Kubernetes
Share

speaker

avatar
Rahul Parundekar
Founder @ A.I. Hero, Inc.

Rahul Parundekar is the founder of AI Hero. He graduated with a Master's in Computer Science from USC Los Angeles in 2010, and embarked on a career focused on Artificial Intelligence. From 2010-2017, he worked as a Senior Researcher at Toyota ITC working on agent autonomy within vehicles. His journey continued as the Director of Data Science at FigureEight (later acquired by Appen), where he and his team developed an architecture supporting over 36 ML models and managing over a million predictions daily. Since 2021, he has been working on AI Hero, aiming to democratize AI access, while also consulting on LLMOps(Large Language Model Operations), and AI system scalability. Other than his full time role as a founder, he is also passionate about community engagement, and actively organizes MLOps events in SF, and contributes educational content on RAG and LLMOps at learn.mlops.community.

+ Read More

SUMMARY

Data Scientists prefer Jupyter Notebooks to experiment and train ML models. Serving these models in production can benefit from a more streamlined approach that can guarantee a repeatable, scalable, and high velocity. Kubernetes provides such an environment. And while third-party solutions for serving models make it easier, this talk demystifies how native K8s operators can be used to deploy models along with best practices for containerizing your own model, and CI/CD using GitOps.

+ Read More

Watch More

Databricks Model Serving V2
Posted Sep 30, 2022 | Views 1.1K
# Databricks
# Deployment
# Real-time ML Models
Building ML/Data Platform on Top of Kubernetes
Posted Mar 10, 2022 | Views 988
# Data Platform
# Building ML
# Kubernetes
Streamlining Model Deployment // Daniel Lenton // AI in Production Talk
Posted Mar 08, 2024 | Views 450
# benchmarks
# open governance
# open source runtime benchmarks
# dynamic routing