[San Francisco Workshop] Deploy and Scale LLM-based applications

Build and deploy LLM-based applications

LLMs have gained immense popularity in recent months. An entirely new ecosystem of pre-trained models and tools has emerged that streamline the process of building LLM-based applications.

Join us for this in-person workshop in San Francisco, CA to experience building scalable LLM-based applications hands-on! Coffee and snacks included. This is a paid workshop to help cover cloud resources and operational costs.

Key Takeaways

1. Use libraries like Ray, HuggingFace, and LangChain to build LLM-based applications based on open-source code, models, and data.
2. Learn about scaling LLM fine-tuning and inference, along with trade-offs.
3. Use embedding models and vector stores.
4. Learn about using modern deployment tools to run your application online and continually improve it.

Audience

1. This workshop is for LLM-based application builders as well as ML practitioners interested in how to build LLM-based applications using open source tools.
2. Basic understanding of emerging LLM trends is not necessary, but will help get more out of the workshop. This and this blog posts are helpful background material.

Resources

1. GitHub repository with relevant resources including notebooks, setup instructions, bonus resources, and a README for an overview.
2. Access to the GPU-based compute cluster for the duration of the training to leverage the full potential of LLMs.
3. Exclusive only to the workshop participants: office hours the week after the workshop for deeper discussion of the individual application ideas.