MLOps Community
timezone
+00:00 GMT
SIGN IN
Sign in or Join the community to continue

LLM in Production Round Table

Posted Mar 21, 2023 | Views 1.3K
# Large Language Models
# LLM in Production
# Cost of Production
Share
SPEAKERS
Diego Oppenheimer
Diego Oppenheimer
Diego Oppenheimer
Partner @ Factory

Diego Oppenheimer is an entrepreneur, product developer and investor with an extensive background in all things data. Currently, he is a Partner at Factory a venture fund specialized in AI investments as well as interim head of product at two LLM startups. Previously he was an executive vice president at DataRobot, Founder and CEO at Algorithmia (acquired by DataRobot) and shipped some of Microsoft’s most used data analysis products including Excel, PowerBI and SQL Server.

Diego is active in AI/ML communities as a founding member and strategic advisor for the AI Infrastructure Alliance and MLops.Community and works with leaders to define ML industry standards and best practices. Diego holds a Bachelor's degree in Information Systems and a Masters degree in Business Intelligence and Data Analytics from Carnegie Mellon University.

+ Read More

Diego Oppenheimer is an entrepreneur, product developer and investor with an extensive background in all things data. Currently, he is a Partner at Factory a venture fund specialized in AI investments as well as interim head of product at two LLM startups. Previously he was an executive vice president at DataRobot, Founder and CEO at Algorithmia (acquired by DataRobot) and shipped some of Microsoft’s most used data analysis products including Excel, PowerBI and SQL Server.

Diego is active in AI/ML communities as a founding member and strategic advisor for the AI Infrastructure Alliance and MLops.Community and works with leaders to define ML industry standards and best practices. Diego holds a Bachelor's degree in Information Systems and a Masters degree in Business Intelligence and Data Analytics from Carnegie Mellon University.

+ Read More
David Hershey
David Hershey
David Hershey
Vice President @ Unusual Ventures

David Hershey is an investor at Unusual Ventures, where he invests in machine learning and data infrastructure. David started his career at Ford Motor Company, where he started their ML infrastructure team. Recently, he worked at Tecton and Determined AI, helping MLOps teams adopt feature stores and scale deep learning workloads.

+ Read More

David Hershey is an investor at Unusual Ventures, where he invests in machine learning and data infrastructure. David started his career at Ford Motor Company, where he started their ML infrastructure team. Recently, he worked at Tecton and Determined AI, helping MLOps teams adopt feature stores and scale deep learning workloads.

+ Read More
Hannes Hapke
Hannes Hapke
Hannes Hapke
Machine Learning Engineer @ Digits Financial, Inc.

Hannes was the first ML engineer at Digits, where he built the MLOPs foundation for their ML team. His interest in production machine learning ranges from building ML pipelines to scaling similarity-based ML to process millions of banking transactions daily.

Prior to Digits, Hannes implemented ML solutions for a number of applications, incl. retail, health care, or ERP companies. He co-author two machine learning books:

  • Building Machine Learning Pipeline (O'Reilly)
  • NLP in Action (Manning)
+ Read More

Hannes was the first ML engineer at Digits, where he built the MLOPs foundation for their ML team. His interest in production machine learning ranges from building ML pipelines to scaling similarity-based ML to process millions of banking transactions daily.

Prior to Digits, Hannes implemented ML solutions for a number of applications, incl. retail, health care, or ERP companies. He co-author two machine learning books:

  • Building Machine Learning Pipeline (O'Reilly)
  • NLP in Action (Manning)
+ Read More
James Richards
James Richards
James Richards
CEO & Co-Founder @ Bountyful AI

James is CEO and Co-Founder of Bountyful - an early-stage startup, backed by Entrepreneur First at pre-seed, building observability and testing tools fit for generative AI use cases. Prior to Bountyful he helped grow and raise funding for ventures in operating teams and at world-class accelerators like Techstars.

+ Read More

James is CEO and Co-Founder of Bountyful - an early-stage startup, backed by Entrepreneur First at pre-seed, building observability and testing tools fit for generative AI use cases. Prior to Bountyful he helped grow and raise funding for ventures in operating teams and at world-class accelerators like Techstars.

+ Read More
Rebecca Qian
Rebecca Qian
Rebecca Qian
Research Engineer @ Facebook AI Research

Rebecca is a Research Engineer at Facebook AI Research, where her research interests focus on the robustness and fairness of large language models. Previously, she worked on robotics and semantic parsing, and developed a novel pattern mining algorithm that processed hundreds of millions of infrastructure logs. She studied CS at the University of Chicago.

+ Read More

Rebecca is a Research Engineer at Facebook AI Research, where her research interests focus on the robustness and fairness of large language models. Previously, she worked on robotics and semantic parsing, and developed a novel pattern mining algorithm that processed hundreds of millions of infrastructure logs. She studied CS at the University of Chicago.

+ Read More
SUMMARY

Using LLM in production. That's right. Hype or here to stay? The conversation answers some of the questions that have been asked by our community members like; performance & cost of production, the difference in architectures, Reliability issues, and a bunch of random tangents. We have some heavy hitters for this event!

+ Read More

Watch More

47:23
Posted Nov 09, 2020 | Views 389
# Interview
9:59
Posted Apr 27, 2023 | Views 881
# LLM
# LLM in Production
# LlamaIndex
53:18
Posted Apr 28, 2021 | Views 362
# Googler
# Panel
# Interview
# Monitoring