LLM in Production Round Table
Speakers

I am a serial entrepreneur, executive, product developer, and investor with a deep passion for data and AI. Currently, I do deep advisory for startups and scale-ups.
My journey includes being a co-founder at Guardrails AI, CEO in Residence at Factory, a venture fund focused on AI investments, founding Algorithmia (acq Datarobot) where I served as CEO, and leading teams at Microsoft to develop key data analysis products like Excel, SQL Server, and PowerBI. I have applied my extensive experience and involvement in the AI/ML community to help drive innovation and set industry standards.

David Hershey devoted most of his career to machine learning infrastructure and trying to abstract away the hairy systems complexity that gets in the way of people building amazing ML applications.

As the principal machine learning engineer at Digits since 2020, Hannes Hapke is fully immersed in day-to-day, evolving innovative ways to use machine learning to boost productivity for accountants and business owners. Prior to joining Digits, Hannes solved machine learning infrastructure problems in various industries including healthcare, retail, recruiting, and renewable energies.
Hannes is an active contributor to TensorFlow’s TFX Addons project and has co-authored multiple machine learning publications including the book "Building Machine Learning Pipelines" by O’Reilly Media. He has also presented state-of-the-art ML work at conferences like ODSC, or O’Reilly’s TensorFlow World.

James is CEO and Co-Founder of Bountyful - an early-stage startup, backed by Entrepreneur First at pre-seed, building observability and testing tools fit for generative AI use cases. Prior to Bountyful he helped grow and raise funding for ventures in operating teams and at world-class accelerators like Techstars.

Rebecca is a Research Engineer at Facebook AI Research, where her research interests focus on the robustness and fairness of large language models. Previously, she worked on robotics and semantic parsing, and developed a novel pattern mining algorithm that processed hundreds of millions of infrastructure logs. She studied CS at the University of Chicago.
SUMMARY
Using LLM in production. That's right. Hype or here to stay? The conversation answers some of the questions that have been asked by our community members like; performance & cost of production, the difference in architectures, Reliability issues, and a bunch of random tangents. We have some heavy hitters for this event!

