Measuring performance

How do you compare chatbot CSAT with human support CSAT?

Compare matched cases with the same scale, survey timing and scoring rule. Separate bot-only, human-only and mixed conversations and display response coverage so the comparison does not confuse feedback bias with quality.

What matters for your decision

If one experience only surveys successful sessions or attracts fewer respondents, do not declare it better on raw scores. Keep complaint and recontact measures next to CSAT.

Make the metric auditable

  1. Report eligible conversations, survey invitations and ratings received for each cohort.
  2. Compare the same contact reasons and channel, including responses from handoffs rather than throwing them out.
  3. Report the distribution or calculation rule alongside the mean or top-box score; avoid overreading tiny cohorts.

Go deeper

Sources

Related questions

Your business. Your shortlist.

Find your best-fit AI support software.

Start with your website. Answer a few focused questions, then get a personalized PDF with fit, trade-offs, alternatives and a pilot plan.

Name, email and business domain are required for the PDF, not to start.

AI Support Software

Your personalized recommendation

By DocsBot · Research → short interview → your PDF.