The hidden complexities of open-source AI // Enrique Ferrao // Agent Hour

The open-source AI ecosystem is evolving rapidly, with frequent releases of new models, architectures, and hardware accelerators. While this flexibility drives innovation, it also introduces significant hidden complexities when fine-tuning and deploying AI models. In this talk, we’ll explore the key challenges teams face when updating fine-tuned models, switching between inference engines, and deploying across different GPUs such as the Nvidia A100, L40s, H100, and Intel Gaudi 2. We’ll share real-world examples, including tokenizer issues, multi-GPU fine-tuning hurdles, and API inconsistencies across AI components.