Join in the meeting room for 2 uninterrupted talks followed by a roundtable discussion

As complex AI agents become common, standard evaluation isn't enough. This presentation provides a structured overview of the critical field of agentic system evaluation. We will briefly explore common single and multi-agent patterns, delve into the fundamental reasons why rigorous evaluation is necessary, and outline core principles for conducting meaningful assessments. This talk covers essential principles, methods (benchmarks, simulation, human feedback), and metrics for evaluating agentic system performance, highlighting key challenges.

This talk explores the complexities and requirements for building AI Agents for financial institutions like banks, credit unions, and fintechs. The focus will be on how to build a scalable and modern architecture capable of handling the complex demands of financial institutions.