MLOps Community
timezone
+00:00 GMT
IN-PERSON
[San Francisco Workshop] Deploy and Scale LLM-based applications

Build and deploy LLM-based applications

LLMs have gained immense popularity in recent months. An entirely new ecosystem of pre-trained models and tools has emerged that streamline the process of building LLM-based applications.

Join us for this in-person workshop in San Francisco, CA to experience building scalable LLM-based applications hands-on! Coffee and snacks included. This is a paid workshop to help cover cloud resources and operational costs.

Key Takeaways

  1. Use libraries like Ray, HuggingFace, and LangChain to build LLM-based applications based on open-source code, models, and data.
  2. Learn about scaling LLM fine-tuning and inference, along with trade-offs.
  3. Use embedding models and vector stores.
  4. Learn about using modern deployment tools to run your application online and continually improve it.

Audience

  1. This workshop is for LLM-based application builders as well as ML practitioners interested in how to build LLM-based applications using open source tools.
  2. Basic understanding of emerging LLM trends is not necessary, but will help get more out of the workshop. This and this blog posts are helpful background material.

Resources

  1. GitHub repository with relevant resources including notebooks, setup instructions, bonus resources, and a README for an overview.
  2. Access to the GPU-based compute cluster for the duration of the training to leverage the full potential of LLMs.
  3. Exclusive only to the workshop participants: office hours the week after the workshop for deeper discussion of the individual application ideas.
Speakers
Emmy Li
Emmy Li
Technical Trainer @ Anyscale
Adam Breindel
Adam Breindel
Technical Instructor @ Anyscale
Josh Tobin
Josh Tobin
Founder @ Gantry
Agenda
Track View
10:00 PM, GMT
-
10:30 PM, GMT
Stage 1
Opening / Closing
calendar
Welcome

Doors open, networking, light snacks

+ Read More
10:30 PM, GMT
-
12:30 AM, GMT+1
Stage 1
In-Person Workshop
calendar
Build and Deploy LLM-based Applications

Join us in-person for this LLM-based applications workshop, where you'll use libraries like Ray, HuggingFace, and LangChain to build LLM-based applications based on open-source code, models, and data.

You'll learn about scaling, LLM fine-tuning and inference, along with trade-offs, and use embedding models and vector stores.

This is a great opportunity to learn about using modern deployment tools to run your application online and continually improve it.

+ Read More
Emmy Li
Adam Breindel
12:30 AM, GMT +1
-
12:31 AM, GMT+1
Stage 1
Opening / Closing
calendar
Closing

Wrap up and head to LLM in Production in-person after party!

+ Read More
Sponsors
Event has finished
June 15, 10:00 PM, GMT
Location
55 Hawthorne St, 9th Floor, San Francisco, CA 94105, San Francisco, California, USA
Event has finished
June 15, 10:00 PM, GMT
Location
55 Hawthorne St, 9th Floor, San Francisco, CA 94105, San Francisco, California, USA
Organized by