How do we measure whether an AI agent is actually following its intended policies?
Join the Agentic AI Foundation community for an informal reading group exploring the paper “Measuring Agent Policy Compliance.”
We’ll read through the paper together, unpacking its approach to measuring policy compliance in AI agents, examining its key ideas and assumptions, and discussing the challenges involved in evaluating agent behavior.
This is not a formal presentation or lecture. It’s a community conversation: bring your questions, interpretations, disagreements, and ideas. We’ll leave plenty of room for open discussion and constructive debate.
We’ll explore:
- How agent policy compliance can be measured
- The paper’s methodology and key ideas
- Challenges in evaluating whether agents follow their intended policies
- Assumptions and limitations of the proposed approach
- Questions and perspectives from the community
- What this could mean for building and evaluating more reliable AI agents
If you’ve read the paper already, come ready to share your perspective. If you haven’t, you’re still welcome - we’ll work through it together.
Come curious. Bring questions. Let’s read the paper together and see where the discussion takes us.