The Power of Small Language Models: Compact Designs for Big Impact

Name: The Power of Small Language Models: Compact Designs for Big Impact
Uploaded: 2024-08-08

Posted Aug 08, 2024 | Views 43

# SLMs

# RAG

# PremAI

speaker

Joshua Alphonse

Director of Developer Relations @ PremAI

Joshua is a seasoned Developer Advocate who leads Developer Relations at PremAI. Joshua has spent his time empowering developers to create innovative solutions using cutting-edge open-source technologies. Previously, Joshua worked at Wix, leading Product and R&D engagements for their Developer Relations Team, and at Bytedance. He successfully created content, tutorials, and curated events for the developer community.

+ Read More

SUMMARY

Small language models (SLMs) are taking the industry by storm. But why would you use them? In this talk, we will uncover the secrets behind crafting compact language models that pack a powerful punch. Despite their reduced size, these models are capable of achieving remarkable performance across a wide range of tasks, especially with RAG (Retrieval-Augmented Generation). We will delve into the innovative techniques and architectures that enable us to compress and optimize language models without sacrificing their effectiveness.

+ Read More

TRANSCRIPT

Slides: https://docs.google.com/presentation/d/199-gCrrW72dy3pRUwWImls0n8H4S0oW1RdslIQlHBvE/edit?usp=sharing

+ Read More