MLOps Community
+00:00 GMT
Sign in or Join the community to continue

LLM in Production Round Table

Posted Mar 21, 2023 | Views 3.1K
# Large Language Models
# LLM in Production
# Cost of Production
Share

speakers

avatar
Diego Oppenheimer
Head of Product @ Hyperparam

I am a serial entrepreneur, executive, product developer, and investor with a deep passion for data and AI. Currently, I do deep advisory for startups and scale-ups.

My journey includes being a co-founder at Guardrails AI, CEO in Residence at Factory, a venture fund focused on AI investments, founding Algorithmia (acq Datarobot) where I served as CEO, and leading teams at Microsoft to develop key data analysis products like Excel, SQL Server, and PowerBI. I have applied my extensive experience and involvement in the AI/ML community to help drive innovation and set industry standards.

+ Read More
avatar
David Hershey
Member of Technical Staff @ Anthropic

David Hershey devoted most of his career to machine learning infrastructure and trying to abstract away the hairy systems complexity that gets in the way of people building amazing ML applications.

+ Read More
avatar
Hannes Hapke
Principal Machine Learning Engineer @ Digits

As the principal machine learning engineer at Digits since 2020, Hannes Hapke is fully immersed in day-to-day, evolving innovative ways to use machine learning to boost productivity for accountants and business owners. Prior to joining Digits, Hannes solved machine learning infrastructure problems in various industries including healthcare, retail, recruiting, and renewable energies.

Hannes is an active contributor to TensorFlow’s TFX Addons project and has co-authored multiple machine learning publications including the book "Building Machine Learning Pipelines" by O’Reilly Media. He has also presented state-of-the-art ML work at conferences like ODSC, or O’Reilly’s TensorFlow World.

+ Read More
avatar
James Richards
CEO & Co-Founder @ Bountyful AI

James is CEO and Co-Founder of Bountyful - an early-stage startup, backed by Entrepreneur First at pre-seed, building observability and testing tools fit for generative AI use cases. Prior to Bountyful he helped grow and raise funding for ventures in operating teams and at world-class accelerators like Techstars.

+ Read More
avatar
Rebecca Qian
Co-founder & CTO @ Patronus AI

Rebecca is a Research Engineer at Facebook AI Research, where her research interests focus on the robustness and fairness of large language models. Previously, she worked on robotics and semantic parsing, and developed a novel pattern mining algorithm that processed hundreds of millions of infrastructure logs. She studied CS at the University of Chicago.

+ Read More

SUMMARY

Using LLM in production. That's right. Hype or here to stay? The conversation answers some of the questions that have been asked by our community members like; performance & cost of production, the difference in architectures, Reliability issues, and a bunch of random tangents. We have some heavy hitters for this event!

+ Read More

Watch More

Tecton Round-table // Get your ML Application Into Production
Posted Sep 26, 2023 | Views 659
# ML Application
# Production
# Tecton 0.6
LLM Use Cases in Production Panel
Posted Feb 28, 2024 | Views 3.8K
# LLM Use Cases
# Startups
# hello.theresidesk.com
# chaptr.xyz
# dataindependent.com
Building LLM Applications for Production
Posted Jun 20, 2023 | Views 11K
# LLM in Production
# LLMs
# Claypot AI
# Redis.io
# Gantry.io
# Predibase.com
# Humanloop.com
# Anyscale.com
# Zilliz.com
# Arize.com
# Nvidia.com
# TrueFoundry.com
# Premai.io
# Continual.ai
# Argilla.io
# Genesiscloud.com
# Rungalileo.io