16 March 2027 11:15 - 11:45
Every agent gets a QA, even the AI: Scaling quality and CSAT across humans and AI
As AI agents take on a growing share of customer conversations, quality assurance can no longer focus on human agents alone. Reviewing a small sample of interactions leaves gaps, and when AI and humans share the workload, both need to be held to the same standard.
This session shares how one support team built a single quality framework covering both agent and AI-agent conversations, using AI QA and conversation intelligence to review far more interactions and close CSAT gaps. Hear how they decided which contact types to automate, balanced the work through routing, agent assist and smooth handoffs, and saw AI resolve 50-65% of digital conversations with CSAT above 85%.
Key learnings:
- How to build one QA framework that covers both human and AI-agent conversations
- How to decide which contact types to hand to AI and which to keep human-led
- How routing, agent assist and handoffs helped roughly triple agent productivity
- Results, lessons learned and what the speaker would do differently