MLOps Community
+00:00 GMT
MLOps IRL
# ML Development
# AI/ML Development
# Netlight.com

Making the ML Development Process Mature & Sustainable

You productionalize AI/ML development by having a good foundation. This can be given by a standard repository structure that helps you create good quality code, and use best practices but also lets you build automation on top of the structure. The focus should always remain on delivering value, guided by strategic decisions on when and how to implement these practices to best support the project's goals and context.
Viking Björk Friström
Albin Sundqvist
Viking Björk Friström & Albin Sundqvist · May 13th, 2024
Popular topics
# MLops
# Machine learning
# Machine Learning
# LLMs
# AI
# Monitoring
# LLM in Production
# Generative AI
# LLM
# Rungalileo.io
# Machine Learning Engineer
# about.gitlab.com
# Interview
# Panel
# Googler
# Kubernetes
# Data Science
# ML Platform
# Forecasting and Optimization
# Flexibility
Latest
Popular
All
Francesca Carminati
Francesca Carminati · May 6th, 2024

Technical Debt in ML Systems

Maintaining Machine Learning systems can be difficult and costly because they often end up with large amount of technical debt. In this presentation we will discuss the reasons why ML systems are more likely to have this type of debt and three sources of technical debt in ML systems.
# ML Systems
# Technical Debt
# King
Anna Maria  Modée
Anna Maria Modée · Apr 29th, 2024

Generative AI & Elastic Observability

The fact that search is not just traditional TF/IDF anymore but the current trend of machine learning and models has opened another dimension for search. This talk gives an overview of: - "Classic" search and its limitations - What is a model and how can you use it - How to use vector search or hybrid search in Elasticsearch - Where ChatGPT or similar LLMs come into play with Elastic
# Generative AI
# LLMs
# Elastic
# Elastic.co
Anna Maria Modée
Francesca Carminati
Rebecka Storm
+1
Anna Maria Modée, Francesca Carminati, Rebecka Storm & 1 more speaker · Apr 22nd, 2024

Stockholm 2024 Community Kick-Off Panel

The panel of guests Anna Maria Modée, Francesca Carminati, and Rebecka Storm, guided by host Saroosh Shabbir, dive into an insightful discussion about the balance of simplicity and complexity within ML systems. They emphasize the need for providing straightforward solutions for common tasks, whilst allowing customization as necessary and prioritizing business impact over mere scalability. The panelists address diverse topics, such as avoiding over-engineering, operational efficiency, code ownership, and managing technical debt. They also discuss the societal implications of AI, data sensitivities, and the necessity for robust safeguards. The lively debate also covers the scalability of ML systems, method validation, co-ownership of projects, and the importance of good documentation practices. The panel sums up pointing out the need for the value of data work to align with company goals, and for technical professionals to bridge the gap between technical solutions and business needs. Finally, they respond to audience questions about model complexity and debt accumulation throughout production processes, sparking thoughts on tools and governance in development.
# ML Systems
# AI
# Model Complexity
# Technical Debt
# Elastic.co
# Twirldata.com
# King.com
# Silo.ai
Analytics and ML often live in separate worlds: analytics happens in SQL and dashboards, and ML in Python and notebooks. However, combining them both in one platform brings a lot of benefits: Speed, consistency, data quality, and autonomy. Building a platform that can work well for both isn’t easy though. In this talk, Rebecka will speak about some approaches she's seen, some tricks on how to avoid analysts and ML engineers getting in each others’ way, and what Twirl is doing to bridge the gap between these two fields.
# ML
# Analytics
# Twirl
# twirldata.com
Savin Goyal, the Co-founder and CTO of Outerbounds and former Netflix tech lead discusses Metaflow, an open-source platform for managing machine learning infrastructure. He explores "Gen AI" and its impact on personalized customer experiences, emphasizing data's crucial role in ML infrastructure, including storage, processing, and security. Savin highlights Metaflow's orchestration capabilities, simplifying deployment for data scientists through Python-based infrastructure as code. The platform addresses engineering challenges like optimizing GPU usage and handling multitenant workloads while emphasizing continuous improvement and reproducibility. Goyal advocates for agile experimentation and the development of "full stack data scientists," presenting Metaflow as a solution for securely connecting to data warehouses and generating embeddings.
# GenAI
# Metaflow
# Outerbounds
# Outerbounds.com
Chandan Maruthi
Chandan Maruthi · Apr 1st, 2024

AI for Customer Experience Teams

Chandan discusses the concept of retrieval-augmented generation (RAG), emphasizing its relevance in enterprise settings where specific data and knowledge take precedence over generalized internet information. He delves into the intricacies of building and optimizing RAG systems, including data pipelines, data ingestion, semantic stores, embeddings, vector stores, semantic search algorithms, and caching. Maruthi also addresses the challenges and considerations in building and fine-tuning AI models to ensure high-quality responses and effective evaluation processes for AI systems. Throughout the talk, he provides practical guidance and valuable considerations for implementing AI solutions to elevate customer experience.
# AI
# RAG
# TwigAI
# Twig.so
Jineet Doshi
Jineet Doshi · Mar 25th, 2024

Evaluating Generative AI Systems

Jineet Doshi, an AI lead at Intuit, offered valuable insights into evaluating generative AI systems. Drawing from his experience architecting Intuit's platform, he discussed various evaluation approaches, including traditional NLP techniques, human evaluators, and LLMs. Jineet highlighted the importance of establishing trust in these systems and evaluating for safety and security. His comprehensive overview provided practical considerations for navigating the complexities of evaluating generative AI systems.
# GenAI
# LLMs
# Intuit
# Intuit.com
Chris Booth shared insights into leveraging autonomous agents to enhance language model (LLM) readiness for production. Drawing from his experience as a Product Owner for machine learning, Chris highlighted the role of autonomous agents in streamlining processes and demonstrated their capabilities through a live financial data extraction demo. He emphasized addressing challenges such as reasoning, latency, and explainability, advocating for techniques like chain prompting and advanced models. Chris also encouraged open-source collaboration to fine-tune LLMs and integrate knowledge graphs for improved performance and reliability.
# Autonomous Agents
# LLMs
# NatWest Groups
# natwestgroup.com
Erik Steinholtz
Erik Steinholtz · Feb 26th, 2024

Surf the Next Wave of Innovation

Erik Steinholtz takes us on a tour of the machine learning workbench and discusses the lifecycle approach to machine learning. Erik provides a comprehensive overview of the process from data discovery to model training and deployment. He also delves into the nuances of classic ML and LLM, emphasizing the importance of platform architecture and asset management. Erik showcases the use of fine-tuning and showcases a fascinating demo of using LLM for text generation and retrieval.
# Machine Learning
# LLM
# Cloudera.com
Erik Steinholtz
Philippe Lanckvrind
Erik Steinholtz & Philippe Lanckvrind · Feb 19th, 2024

Data Streaming in Action: From Kafka to Flink

Erik Steinholtz and Philippe Lanckvrind share their insights on what makes us human, the fascinating world of streaming analytics, and the geeky aspect of creating simple use cases that prove the relevance of different approaches. From discussions on QR codes and turning the tables on human versus computer judgments to exploring the intricacies of streaming analytics, this episode offers a deep dive into the world of technology and its impact on our daily lives.
# LLM
# RAG
# Cloudera
Popular