How to check an AI answer: a practical evidence checklist
Checking an AI answer means testing its factual claims against appropriate evidence and examining whether its conclusion follows. Start with the statements that could change a decision, open the original sources and match the period, units and definitions. A link, confident tone or repeated answer does not by itself establish accuracy.
Our fictional example is an AI-written summary of a workshop’s published schedule. The method also applies to learning notes and content drafts. It is an editorial checking routine; high-stakes questions still require sources and review appropriate to their subject.
Key ideas
- Break the answer into claims you can test.
- Open the source rather than trusting its title.
- Match dates, units and the scope of the statement.
- Record unresolved claims before publishing or acting.
Separate facts, interpretations and suggestions
Highlight statements such as 'the workshop starts Tuesday' or 'the session is suitable for beginners'. The first may be checked against a schedule; the second may be an interpretation of prerequisites. A suggested study plan is a proposal, not a fact about the organiser. Splitting these categories prevents a useful suggestion from quietly becoming an official promise. Prioritise claims about dates, availability, prices and instructions because a mistake there can change the next action.
Find the original passage behind each claim
Open the organiser’s current page and look for the exact item. A homepage about the workshop does not establish every detail in the generated answer. Check whether the cited page exists, supports the claim and identifies the relevant version. Search results and another AI summary may help you locate evidence, but they are not substitutes for reading it. If the schedule is not published, say so instead of constructing a plausible date.
Compare the details that change meaning
Record the publication date, event date, location, units and qualifications. An announcement made today may describe a future session. A maximum capacity differs from actual attendance, and an example price differs from an official offer. Watch for words such as 'planned', 'estimated' or 'subject to confirmation'. Keep them in your explanation. Removing a qualification can turn an accurate source into an inaccurate answer even when the copied number remains unchanged.
Turn the check into a useful revision
Create a short claim-to-source table with a result: supported, contradicted or unresolved. Correct the answer using the evidence and retain a note of the changed claim. Ask whether the revised conclusion still follows. If the key fact remains unresolved, narrow the answer or explain the gap. The goal is a useful statement with visible support, not a polished paragraph that hides uncertainty. Use the same routine on your own first draft as on a generated one.
In everyday language
Imagine checking a map before giving someone directions. You need the relevant street, the current route and the right destination. A confident description of the city is insufficient. An AI answer needs the same kind of matching between a specific claim and the evidence that supports it.
Try it yourself
Write four claims from a generated workshop summary. Link each to an original page or mark it unresolved. Include one deliberately altered date and explain why the change matters.
Expected result
A claim-to-source note with corrected wording, preserved qualifications and an explicit limit where the source gives no answer. Keep the original and revised draft for comparison.
Check your answer: The source contains the number in the answer. Is that enough?
No. Confirm what the number measures, its unit, time period and whether it is observed, estimated or planned. The same number can describe different things, so its presence alone does not verify the statement.
Questions
Does asking AI for citations solve the problem?
Citations give you candidates to inspect. They can be missing, outdated or unrelated to the claim, and a real source may be interpreted incorrectly. Open the page and compare the relevant passage with the answer. Keep a visible record of support and uncertainty. A citation format or a long source list cannot replace that check.
Should every sentence have a source?
A practical instruction or clearly labelled fictional example can be explained directly. Factual claims about current products, events, numbers or research need appropriate evidence. Concentrate on the statements that establish the answer and affect decisions. Avoid decorating an unsupported claim with a general link; explain which source actually supports it and preserve its limitations.
Match important claims to original evidence. A good correction makes the answer clearer and its uncertainty visible.
Sources and further reading
- Anthropic — Prompt engineering overview ↗Sources checked:
- Google Search Central — Creating helpful content ↗Sources checked:
- Anthropic — Building effective agents ↗Sources checked: