Troubleshooting

Why does an AI support chatbot keep quoting an old policy after an update?

A source edit does not prove the searchable copy changed. Trace whether the latest version was ingested and retrieved, whether duplicated or cached copies are still eligible, and which passage the bot actually cited.

What matters for your decision

If the new passage never reaches retrieval, fix syncing or source removal before changing prompts. If both versions are retrieved, make precedence explicit and remove obsolete ambiguity.

Diagnose before changing settings

  1. Compare authoring timestamp, last successful sync, indexed version and citation for the same test query.
  2. Search for duplicate source copies and confirm the old one is removed from the index, not just the source CMS.
  3. Retest the old and new policy examples as the intended audience and keep the evidence for future edits.

Go deeper

Sources

Related questions

Your business. Your shortlist.

Find your best-fit AI support software.

Start with your website. Answer a few focused questions, then get a personalized PDF with fit, trade-offs, alternatives and a pilot plan.

Name, email and business domain are required for the PDF, not to start.

AI Support Software

Your personalized recommendation

By DocsBot · Research → short interview → your PDF.