MLOps Community
timezone
+00:00 GMT
Sign in or Join the community to continue

LLM in Production Round Table

Posted Mar 21, 2023 | Views 2.7K
# Large Language Models
# LLM in Production
# Cost of Production
Share
SPEAKERS
Diego Oppenheimer
Diego Oppenheimer
Diego Oppenheimer
Co-founder @ Guardrails AI

Diego Oppenheimer is a serial entrepreneur, product developer and investor with an extensive background in all things data. Currently, he is a Partner at Factory a venture fund specialized in AI investments as well as a co-founder at Guardrails AI. Previously he was an executive vice president at DataRobot, Founder and CEO at Algorithmia (acquired by DataRobot) and shipped some of Microsoft’s most used data analysis products including Excel, PowerBI and SQL Server.

Diego is active in AI/ML communities as a founding member and strategic advisor for the AI Infrastructure Alliance and MLops.Community and works with leaders to define AI industry standards and best practices. Diego holds a Bachelor's degree in Information Systems and a Masters degree in Business Intelligence and Data Analytics from Carnegie Mellon University.

+ Read More

Diego Oppenheimer is a serial entrepreneur, product developer and investor with an extensive background in all things data. Currently, he is a Partner at Factory a venture fund specialized in AI investments as well as a co-founder at Guardrails AI. Previously he was an executive vice president at DataRobot, Founder and CEO at Algorithmia (acquired by DataRobot) and shipped some of Microsoft’s most used data analysis products including Excel, PowerBI and SQL Server.

Diego is active in AI/ML communities as a founding member and strategic advisor for the AI Infrastructure Alliance and MLops.Community and works with leaders to define AI industry standards and best practices. Diego holds a Bachelor's degree in Information Systems and a Masters degree in Business Intelligence and Data Analytics from Carnegie Mellon University.

+ Read More
David Hershey
David Hershey
David Hershey
Vice President @ Unusual Ventures

David Hershey is an investor at Unusual Ventures, where he invests in machine learning and data infrastructure. David started his career at Ford Motor Company, where he started their ML infrastructure team. Recently, he worked at Tecton and Determined AI, helping MLOps teams adopt feature stores and scale deep learning workloads.

+ Read More

David Hershey is an investor at Unusual Ventures, where he invests in machine learning and data infrastructure. David started his career at Ford Motor Company, where he started their ML infrastructure team. Recently, he worked at Tecton and Determined AI, helping MLOps teams adopt feature stores and scale deep learning workloads.

+ Read More
Hannes Hapke
Hannes Hapke
Hannes Hapke
Principal Machine Learning Engineer @ Digits

As the principal machine learning engineer at Digits since 2020, Hannes Hapke is fully immersed in day-to-day, evolving innovative ways to use machine learning to boost productivity for accountants and business owners. Prior to joining Digits, Hannes solved machine learning infrastructure problems in various industries including healthcare, retail, recruiting, and renewable energies.

Hannes is an active contributor to TensorFlow’s TFX Addons project and has co-authored multiple machine learning publications including the book "Building Machine Learning Pipelines" by O’Reilly Media. He has also presented state-of-the-art ML work at conferences like ODSC, or O’Reilly’s TensorFlow World.

+ Read More

As the principal machine learning engineer at Digits since 2020, Hannes Hapke is fully immersed in day-to-day, evolving innovative ways to use machine learning to boost productivity for accountants and business owners. Prior to joining Digits, Hannes solved machine learning infrastructure problems in various industries including healthcare, retail, recruiting, and renewable energies.

Hannes is an active contributor to TensorFlow’s TFX Addons project and has co-authored multiple machine learning publications including the book "Building Machine Learning Pipelines" by O’Reilly Media. He has also presented state-of-the-art ML work at conferences like ODSC, or O’Reilly’s TensorFlow World.

+ Read More
James Richards
James Richards
James Richards
CEO & Co-Founder @ Bountyful AI

James is CEO and Co-Founder of Bountyful - an early-stage startup, backed by Entrepreneur First at pre-seed, building observability and testing tools fit for generative AI use cases. Prior to Bountyful he helped grow and raise funding for ventures in operating teams and at world-class accelerators like Techstars.

+ Read More

James is CEO and Co-Founder of Bountyful - an early-stage startup, backed by Entrepreneur First at pre-seed, building observability and testing tools fit for generative AI use cases. Prior to Bountyful he helped grow and raise funding for ventures in operating teams and at world-class accelerators like Techstars.

+ Read More
Rebecca Qian
Rebecca Qian
Rebecca Qian
Co-founder & CTO @ Patronus AI

Rebecca is a Research Engineer at Facebook AI Research, where her research interests focus on the robustness and fairness of large language models. Previously, she worked on robotics and semantic parsing, and developed a novel pattern mining algorithm that processed hundreds of millions of infrastructure logs. She studied CS at the University of Chicago.

+ Read More

Rebecca is a Research Engineer at Facebook AI Research, where her research interests focus on the robustness and fairness of large language models. Previously, she worked on robotics and semantic parsing, and developed a novel pattern mining algorithm that processed hundreds of millions of infrastructure logs. She studied CS at the University of Chicago.

+ Read More
SUMMARY

Using LLM in production. That's right. Hype or here to stay? The conversation answers some of the questions that have been asked by our community members like; performance & cost of production, the difference in architectures, Reliability issues, and a bunch of random tangents. We have some heavy hitters for this event!

+ Read More

Watch More

35:23
Posted Jun 20, 2023 | Views 9.8K
# LLM in Production
# LLMs
# Claypot AI
# Redis.io
# Gantry.io
# Predibase.com
# Humanloop.com
# Anyscale.com
# Zilliz.com
# Arize.com
# Nvidia.com
# TrueFoundry.com
# Premai.io
# Continual.ai
# Argilla.io
# Genesiscloud.com
# Rungalileo.io