AI Chatbot Conflicting Sources: When Pages Disagree

AI chatbot conflicting sources are a problem that most teams discover by accident. A customer asks about the return window, the chat answers “30 days”, the customer quotes it back to your support team, and your own returns page says 14. Nothing was invented. The assistant read two of your pages, and the pages disagreed. This guide explains why conflicts appear, how to find them before customers do, how to settle them in one place and how to write instructions that keep the assistant safe while you fix the content.

The advice applies to any assistant that answers from your own content. Talkmio’s assistant, Mio, reads your website, FAQ and uploaded documents and answers only from that content, so the quality of its answers is the quality of your sources, including the places where they contradict each other.

Why AI Chatbot Conflicting Sources Appear

Every assistant that answers from a knowledge base inherits its flaws. Websites grow over years, and nobody reads all of it at once. A price changes on the pricing page but not in a blog post from last spring. A policy is rewritten in the terms but the FAQ still carries the old wording. A PDF brochure uploaded two years ago still lists a discontinued plan. Each page was correct when it was written, and together they make a small mess.

Human visitors rarely notice, because they read one page. An assistant that reads everything meets all of them. If it retrieves the old page for a question, it will quote the old page faithfully. That is the nature of single source of truth problems: the fault lies in having several sources, not in the way one of them is read. Our guide to grounded AI chatbot answers explains why answering from your content is the right design, and why it exposes this issue.

Where Contradictions Hide

Contradictions cluster in a few predictable places. The table lists them, with the kind of conflict you are likely to find.

Where	Typical conflict	Why it happens
Pricing and plans	Old price or limit in a blog post or PDF	Content written once and never revisited
Returns and shipping	Different windows or costs on FAQ, terms and product pages	Policy changed in one place only
Opening hours	Contact page, footer and map listing disagree	Seasonal changes applied unevenly
Product specifications	Datasheet differs from the product page	Two teams maintain two documents
Languages	Translated page lags behind the English one	Updates not carried over
Promotions	Expired offer still described on a landing page	Campaign pages left online
Uploaded files	Old PDF contradicts the live website	Files stay in the knowledge base after the website changes

The last row deserves special attention. In Talkmio you add your website, single pages, Q&A pairs, free text and files (PDF, DOCX, TXT, MD, CSV, HTML) in Mio AI, and each source stays until you remove or re-read it. A file uploaded last year does not update itself when your website changes.

How to Find Conflicts Before Customers Do

You do not need special software to find most conflicts. You need a list of the facts that matter and a habit of checking them. Start with the twenty facts customers ask about most: prices, plan limits, delivery times and costs, return and refund rules, warranty terms, opening hours, contact routes and payment methods. For each, search your website and your uploaded files for every mention and compare them.

Then test the assistant. Open Try Mio and ask each of the twenty questions in the words customers use, and in more than one language if you serve several. For every answer, Try Mio shows which knowledge pieces were used, which tells you exactly which page or file the claim came from. If an answer surprises you, the source list shows where it came from, and that is where the conflict lives. Our guide to testing an AI chatbot before launch offers a fuller test plan.

Also read real conversations. The Inbox search by text finds every chat that mentioned a topic, and chats where the visitor said “your website says something different” are the most valuable of all, because the customer has found the conflict for you.

Fix the Content, Not the Chat

The lasting solution is to remove the contradiction, not to teach the assistant to guess which page to trust. Decide which source is correct, and then correct or retire the others. For each conflict:

Confirm the true fact with the person who owns it, such as finance for prices or logistics for delivery.
Update the page that should be the authority, usually the policy page or the pricing page.
Update or delete every other mention, including blog posts, landing pages and translated pages.
Remove or replace outdated uploaded files, and add a note in the filename or the first line with the date.
Use Re-read on the website source in Mio AI so the assistant sees the change.
Ask the same question again in Try Mio and confirm the answer.

Where a fact must appear in many places, such as the price on several pages, keep the wording identical and consider linking to the authority page instead of repeating the number. Fewer copies mean fewer conflicts. Our article on keeping an AI chatbot’s knowledge base up to date explains how to build the habit.

Use Q&A Pairs for the Facts That Matter Most

For a small set of critical facts, a short Q&A pair is a robust way to say the answer once, clearly. “How long do I have to return an item? You have 14 days from delivery.” A pair is short, specific and easy to review. It does not replace the policy page, but it gives the assistant a precise statement that matches the page.

The risk is that a pair becomes one more copy that goes out of date. Keep a simple register of every pair, with the page it mirrors and the person who owns it. When the policy changes, update the page and the pair on the same day. Pairs are also useful for answering in a particular tone or with an explicit limit, such as “we do not offer cash refunds for online orders”, which a long policy might state only in passing.

Instructions for Uncertain Cases

While you clean up, use the business instructions as a safety net. They tell Mio what you sell, the tone to use and what it must never promise. Add rules for uncertain facts: “for prices, delivery times and return rules, use the pricing page and the returns page as the authority; if sources differ or you are not sure, say that you will check and hand the chat to the team”. Then test the rule in Try Mio with a deliberately contradictory pair of sources.

Be modest about what instructions can do. They guide the assistant but they do not repair a broken page, and a rule such as “trust the newer page” only works if pages carry visible dates. Treat instructions as a seat belt, not as the plan. Our guide to writing AI chatbot instructions gives practical examples.

What Happens When a Conflict Reaches a Customer

Despite your best efforts, one will. A customer quotes the chat’s answer and your team knows it is wrong. Handle it in four steps. First, apologise and honour the customer’s reasonable expectation if the error came from your content; it is cheaper than the argument. Second, find the source: open the conversation in the Inbox and check which page the claim came from. Third, fix the content, using the steps above. Fourth, add a note to the conversation for your team, using an internal note visible only to them, so that nobody repeats the mistake.

It also helps to keep a short list of “known risky facts” that your team checks every month, such as shipping cut-off dates before holidays or price changes after a campaign. A ten-minute review each month prevents most incidents. Our guide to AI chatbot accuracy audits explains how to run one.

Languages and Translated Pages

Conflicts multiply across languages. A translated page that lags behind the original quietly contradicts it, and visitors who read the translation get the old fact. Mio replies in the language the visitor writes in, and questions in one language can find answers written in another, so a Lithuanian visitor may be answered from an English page even when a Lithuanian page exists and says something different.

The practical rule is to update all language versions of a critical fact at the same time, or to remove the fact from the translated page and link to the authority page. If you cannot keep a translation current, it is safer to retire it than to leave it as a trap. Review translated policy pages as part of the monthly check.

A Simple Routine That Prevents Most Conflicts

Name an owner for each critical fact and keep a short register.
When a fact changes, search the whole website and the uploaded files for every mention.
Update or remove every copy on the same day, then Re-read the source in Mio AI.
Test the affected questions in Try Mio and note which pieces were used.
Review the Inbox monthly for chats where customers pointed out a difference.
Delete uploaded files that no longer match the website.

The routine takes minutes a month and protects the trust that an honest assistant builds. See the documentation for how sources, re-reading and Try Mio work.

Frequently Asked Questions

Why does my AI chatbot give different answers to the same question?

Often because your sources disagree. The assistant answers from the pages and files it reads, so an old page or an outdated PDF can produce a different answer from your current policy. Use Try Mio to see which pieces each answer used, then fix or remove the conflicting source.

Can I tell the chatbot which page to trust?

You can add a business instruction that names the authority page for prices, delivery or returns and tells Mio to hand over when sources differ. Treat it as a safety net and test it in Try Mio. The lasting fix is to correct or remove the contradicting content.

How do I find which source caused a wrong answer?

Ask the question in Try Mio. It shows the answer and the knowledge pieces that were used, so you can see whether the claim came from a page, a Q&A pair or an uploaded file. For a real chat, search the Inbox for the conversation and compare it with your sources.

Do uploaded files update when my website changes?

No. A file stays as uploaded until you replace or remove it. The website source can be read again on demand with Re-read. After a change, re-read the website and delete or replace any uploaded document that still shows the old information.

Are Q&A pairs a good way to settle conflicts?

For a few critical facts, yes. A short pair states the answer once and clearly. Keep a register of pairs with the page each one mirrors, and update both on the same day, otherwise the pair becomes another outdated copy.

How often should I check for conflicts?

Check whenever a price, policy or opening time changes, and run a short review monthly. Ask your twenty most important questions in Try Mio, read recent chats where customers noticed differences and remove outdated files. Ten minutes a month prevents most problems.

The Bottom Line

AI chatbot conflicting sources mean the assistant is repeating your own contradictions, and the cure is to keep one clear source for each important fact. Find conflicts with Try Mio and the Inbox, fix the content, re-read the source and use instructions as a safety net while you work. Mio answers only from what you give it, so what you give it should agree with itself. Create a free Talkmio account, add your website and see what Mio says about your prices today.

AI Chatbot Conflicting Sources: When Your Pages Disagree