MLOps Community Meetup in NYC @ Spotify

Name: MLOps%20Community%20Meetup%20in%20NYC%20@%20Spotify
Uploaded: 2022-11-01T14:18:21.222Z

Posted Nov 01, 2022 | Views 1K

# Ray

# On Device

# Model Serving at Scale

Divita Vohra

Senior Product Manager @ Spotify

Divita is an AI/ML Product Manager at Spotify focused on defining the next generation of ML Infrastructure and scaling ethical ML development practices across Spotify. She holds a BS in Computer Engineering from Virginia Tech and an MS in Computer Science from Georgia Tech.

+ Read More

Olga Nikonova

Senior ML Infra Engineer @ Spotify

Olga Nikonova is a Senior ML Infra Engineer at Spotify, where she has worked for close to two years. Prior to Spotify, she worked at Instagram and Microsoft. She holds a degree in computer science and resides in New York.

+ Read More

SUMMARY

Accelerating ML Research and Prototyping with Ray Spotify started evaluating Ray on Kubernetes as a distributed compute platform that enables ML research and experimentation for ML workflows in early 2022. Ray and its ecosystem provide researchers and data scientists at Spotify with a better model development experience, instant access to distributed computing, and an expressive programming interface. These features greatly complement our existing production ML workflow.

In this talk, we share the story of how Ray started at Spotify, what our long-term goals are with Ray, and how Ray enabled tangible business impact for Spotify by accelerating an ML research use case for improving podcast recommendations.

Supporting Model Serving at Scale: From Backend to On Device Recently our ML serving team expanded its scope from backend infra to on-device models. The talk covers some (early) observations on this project and the new challenges that came with it.

+ Read More