AI Basics
AI hallucination
When an AI tool states something false or made-up as if it were fact, such as an invented quote, source or statistic.
- Parents
- Educators and school leaders
What parents should know
An AI hallucination is a confident mistake. The tool states a fake quote, a fake source, or a wrong number as if it were true. This happens because the tool is built to produce a likely sentence, not to guarantee a fact. Teach your child to check anything that will be turned in, shared, or used to make a decision.
On this page
What is an AI hallucination?
An AI hallucination is a false statement from an AI system, delivered as if it were true. The invented piece might be a quotation, a book title, a court case, a statistic, or a step in a set of directions. The sentence can sound smooth. The error is in the content, not the grammar.
NIST discusses this failure mode in its Generative Artificial Intelligence Profile, using the word confabulation for content that is confidently stated and erroneous. Researchers and product teams also say hallucination. The everyday meaning is the same: the system produced something that is not true, and it did not flag the doubt.
Hallucinations are a normal risk of generative text tools. Adding a web search can reduce some errors and can also introduce new ones if the tool misreads a page. A citation is not proof until a person opens it and sees the fact in the source.
Why an AI hallucination matters
Kids are still learning how to judge a source. A tool that sounds like a textbook can shortcut that skill. A made-up citation in a history paper, a wrong dosage in a health answer, or a fake quote from a public figure can travel into a classroom or a group chat before anyone checks.
Schools feel this when students submit work they cannot explain, or when a detection tool accuses a student who wrote the words themselves. The more reliable classroom response is to ask students to show their sources and their process. Punishing on the basis of a detector alone creates a second error.
At home, the repair is a habit. Read the answer out loud. Ask, how would we check this? Open one source together. Praise the catch. Children who expect AI to be wrong some of the time use it more carefully than children who think it is a search engine that cannot fail.
How it shows up in practice
- A chatbot invents a scientific study, complete with authors and a journal name that do not exist.
- A student cites a quote in an essay, and the quote is not in the book.
- A health answer gives a firm instruction that a pediatrician would not give.
- An image tool writes text inside a picture, and the letters are garbled or the fact on the sign is wrong.
- A teacher asks students to paste the prompt and highlight one claim they verified.
How HeyOtto helps
When Otto helps with schoolwork, it teaches the step and asks the student to try it. A made-up answer is easier to catch when the student still has to do the work. In HeyOtto for Schools, a teacher or advisor can open that session and talk about the wrong claim with the work on the screen.
- Homework help is step-by-step, not a finished answer to paste.
- Teacher and advisor dashboards show how the student used the tool.
- Schools choose which student tools are available.
For schools
Request a demoFAQs
Why do AI chatbots make things up?
They are built to produce a likely next sentence from patterns in their training, not to look up a guaranteed fact. When the pattern points at a plausible detail, the tool may state it with confidence. That is a hallucination. Search features and citations can help, and they still need a person to open the source.
How can I spot an AI hallucination?
Slow down on names, numbers, quotes, and links. Search for the exact quote. Open the citation. If a medical, legal, or safety answer is specific, check it with a qualified person or an official page. A polished tone is not evidence. If your child cannot explain the answer, treat that as a reason to review it.
Are AI hallucinations the same as lying?
People lie on purpose. A hallucination is a system producing false content without a human intent behind that sentence. The effect on a reader can still be the same: they believe something untrue. Teach the behavior, which is to check, rather than arguing about whether the software meant it.
What should teachers do when a chatbot cites a fake source?
Use it as a lesson. Ask the student to open the source and mark what is real. Make source-checking part of the assignment before the grade depends on it. School rules should say when AI help is allowed. A detector score, on its own, is a weak basis for accusing a student.
Sources
Last reviewed September 26, 2026. This entry is reviewed twice a year.