MLOps Community
+00:00 GMT
Sign in or Join the community to continue

Model Monitoring: The Million Dollar Problem, Model Monitoring: The Million Dollar Problem, Model Monitoring: The Million Dollar Problem, Model Monitoring: The Million Dollar Problem

Posted Nov 24, 2021 | Views 782
# Panel
# Presentation
# Monitoring
# Loka.com
Share
speakers
avatar
Alexandre Domingues
Machine Learning Team Lead @ Loka

Alexandre Domingues is an ML Team Lead at Loka, He holds a Masters in Electrical and Computer Engineering and a Ph.D. in Biomedical Engineering. He loves the interface between engineering/ML and life sciences and finding elegant solutions to hard problems.

+ Read More
avatar
Diogo Oliveira
ML Engineer @ Loka

Diogo Oliveira is a Machine Learning Engineer at Loka. He has an MSC in Electrical and Computer Engineering majoring in Systems, Decision, and Control from Instituto Superior Técnico. He is passionate about data science and ML and loves learning new things. Outside work he loves gaming, surfing, hiking, krav maga, and riding his bike.

+ Read More
avatar
Nicolás Roldán
ML Engineer @ Loka

Nicolás Roldán is a Machine Learning Engineer at Loka. He has a Bachelor in Science in Biomedical Engineering with the main emphasis on Biomedical Signal and Image processing. Also, he holds the AWS Machine Learning Specialty Certification and has been working using AWS in different projects related to development, labeling, training, and deploying ML models. When he is not coding, he enjoys reading manga and playing souls like video games.

+ Read More
avatar
Bojan Ilijoski
Senior Data Science & ML Engineer @ Loka

Bojan Ilijoski is a Senior Machine Learning and Data Science engineer at Loka. He is also a Ph.D. student and a teaching and research assistant at SS. Syril and Methodius University. Bojan loves exercising his curiosity both mentally and physically. He’s a programming and sports lover, Pythonista and father, runner, and biker who’s interested in AI, algorithms, and HPC. When he’s offline, Bojan is probably out hiking or immersed in a game of backgammon at the local cafe.

+ Read More
SUMMARY

Model and data monitoring is a crucial part of a production ML system — a lot can go wrong: model drift, data anomalies, upstream data, or processing failures. And mistakes can be costly if ML drives mission-critical systems like recommendation systems, credit approval, or fraud detection, easily meaning millions of dollars lost for large organizations. So, why do so few companies have ML monitoring fully implemented? The Loka team works with venture-backed startups and innovation programs in enterprises to implement end-to-end ML systems and brings their diverse experience to this Meetup. In the Meetup, several of Loka’s MLOps experts provide a thorough overview of model monitoring, the benefits for your business, and reference architectures to get you started. They also provide an introduction to several managed and open source solutions including SageMaker Model Monitor and Great Expectations. Bonus material includes access to a hands-on exercise for learning SageMaker Model Monitor., Model and data monitoring is a crucial part of a production ML system — a lot can go wrong: model drift, data anomalies, upstream data, or processing failures. And mistakes can be costly if ML drives mission-critical systems like recommendation systems, credit approval, or fraud detection, easily meaning millions of dollars lost for large organizations. So, why do so few companies have ML monitoring fully implemented? The Loka team works with venture-backed startups and innovation programs in enterprises to implement end-to-end ML systems and brings their diverse experience to this Meetup. In the Meetup, several of Loka’s MLOps experts provide a thorough overview of model monitoring, the benefits for your business, and reference architectures to get you started. They also provide an introduction to several managed and open source solutions including SageMaker Model Monitor and Great Expectations. Bonus material includes access to a hands-on exercise for learning SageMaker Model Monitor., Model and data monitoring is a crucial part of a production ML system — a lot can go wrong: model drift, data anomalies, upstream data, or processing failures. And mistakes can be costly if ML drives mission-critical systems like recommendation systems, credit approval, or fraud detection, easily meaning millions of dollars lost for large organizations. So, why do so few companies have ML monitoring fully implemented? The Loka team works with venture-backed startups and innovation programs in enterprises to implement end-to-end ML systems and brings their diverse experience to this Meetup. In the Meetup, several of Loka’s MLOps experts provide a thorough overview of model monitoring, the benefits for your business, and reference architectures to get you started. They also provide an introduction to several managed and open source solutions including SageMaker Model Monitor and Great Expectations. Bonus material includes access to a hands-on exercise for learning SageMaker Model Monitor., Model and data monitoring is a crucial part of a production ML system — a lot can go wrong: model drift, data anomalies, upstream data, or processing failures. And mistakes can be costly if ML drives mission-critical systems like recommendation systems, credit approval, or fraud detection, easily meaning millions of dollars lost for large organizations. So, why do so few companies have ML monitoring fully implemented? The Loka team works with venture-backed startups and innovation programs in enterprises to implement end-to-end ML systems and brings their diverse experience to this Meetup. In the Meetup, several of Loka’s MLOps experts provide a thorough overview of model monitoring, the benefits for your business, and reference architectures to get you started. They also provide an introduction to several managed and open source solutions including SageMaker Model Monitor and Great Expectations. Bonus material includes access to a hands-on exercise for learning SageMaker Model Monitor.

+ Read More

Watch More

51:34
Model Monitoring in Practice: Top Trends
Posted Apr 14, 2022 | Views 930
# Responsible AI
# Explainable AI
# AI Model Governance
# Fiddler.ai
# Fiddler AI
Model Performance Monitoring and Why You Need it Yesterday
Posted Jun 01, 2021 | Views 704
# Machine Learning
# ML Monitoring
# Fiddler AI
# Fiddler.ai
Solving the Last Mile Problem of Foundation Models with Data-Centric AI
Posted Apr 18, 2023 | Views 2K
# LLM in Production
# Foundation Models
# Data-centric AI
# Snorkel.ai
# Rungalileo.io
# Wandb.ai
# Tecton.ai
# Petuum.com
# mckinsey.com/quantumblack
# Wallaroo.ai
# Union.ai
# Redis.com
# Alphasignal.ai
# Bigbraindaily.com
# Turningpost.com