MLOps Community
+00:00 GMT
Sign in or Join the community to continue

All About Evaluating LLM Applications

Posted Sep 28, 2023 | Views 825
# Evaluation
# LLM Applications
# Exploding Gradients
Share
speakers
avatar
Shahul Es
Founder @ Exploding Gradients

I am Data science expert well acquainted with Data analytics, classical ML, NLP, and audio processing. I am a Kaggle GrandMaster. I love contributing to opensource and has contributed & created several opensource ML projects.

+ Read More
avatar
Demetrios Brinkmann
Chief Happiness Engineer @ MLOps Community

At the moment Demetrios is immersing himself in Machine Learning by interviewing experts from around the world in the weekly MLOps.community meetups. Demetrios is constantly learning and engaging in new activities to get uncomfortable and learn from his mistakes. He tries to bring creativity into every aspect of his life, whether that be analyzing the best paths forward, overcoming obstacles, or building lego houses with his daughter.

+ Read More
SUMMARY

Shahul Es, renowned for his expertise in the evaluation space and the creator of the Ragas Project. Shahul dives deep into the world of evaluation in open source models, sharing insights on debugging, troubleshooting, and the challenges faced when it comes to benchmarks. From the importance of custom data distributions to the role of fine-tuning in enhancing model performance, this episode is packed with valuable information for anyone interested in language models and AI.

+ Read More

Watch More

49:50
Evaluating LLM-based Applications
Posted Jun 20, 2023 | Views 2.3K
# LLM in Production
# LLM-based Applications
# Redis.io
# Gantry.io
# Predibase.com
# Humanloop.com
# Anyscale.com
# Zilliz.com
# Arize.com
# Nvidia.com
# TrueFoundry.com
# Premai.io
# Continual.ai
# Argilla.io
# Genesiscloud.com
# Rungalileo.io