Skip to main content

How language models work

AI hallucination

An AI hallucination is a statement by an AI system that sounds plausible but is false or rests on no source. It arises because language models produce probable answers rather than verified ones.

Also: Hallucination · LLM hallucination · Confabulation · AI misinformation

Digital & Visibility Analyst, CodaAI

Updated: 4 min read

An AI hallucination is a statement by an AI system that sounds plausible but is false or rests on no source. The system invents, for example, a product feature, a price, a study or a URL and presents it with the same confidence as an established fact. As a rule, there is no indication that it was guessing.

How does an AI hallucination arise?

The first cause lies in how a language model works. An LLM produces text by calculating the most probable continuation — not the verified one. In September 2025, a research team led by Adam Tauman Kalai (OpenAI) argued that models guess when uncertain because training and evaluation reward guessing and penalise admitting uncertainty (Why Language Models Hallucinate).

The second cause is gaps in model knowledge. Models know frequently described facts well and rare ones poorly. Duane Forrester points to research showing that larger models mainly improve their recall of popular facts and gain little on rare ones (August 2026). A mid-sized manufacturer usually sits exactly in that thin part.

The third cause is outdated sources. What a model learned in training ends at its knowledge cut-off. Lily Grozeva observes language models naming executives who left a company 15 years ago (August 2026).

Which forms of AI hallucination affect companies?

Duane Forrester distinguishes random hallucinations — an invented source, a wrong figure — from systematic “substitution”: when a model has little material on a company, it describes something well documented nearby instead (August 2026). He names four forms:

FormWhat happens
Silent analogyThe model describes the nearest well-documented neighbour — often a competitor — as your company.
Staleness presented as currencyA state that was once correct appears in the present tense: discontinued products, departed executives.
Thin evidence, full confidenceA claim resting on a single source sounds like broad consensus.
Category instead of companyThe model answers the question for the industry and attaches your name.

Forrester’s conclusion: models are getting better at not inventing things — but not at knowing about companies that hardly anyone has written about.

How common are AI hallucinations?

Reliable figures exist only for narrowly defined tasks. In a study published in October 2025 by the European Broadcasting Union (EBU) and the BBC, journalists assessed more than 3,000 answers from ChatGPT, Copilot, Gemini and Perplexity on news content. 20% contained major accuracy issues, including hallucinated details and outdated information. That rate cannot be transferred directly to questions about companies.

Why does grounding reduce hallucinations without preventing them?

Grounding gives the model sources on which to base its answer. That lowers the risk of invented facts. Three gaps remain:

  • Wrong sources: if the page it finds is wrong or out of date, the answer inherits the error.
  • Missing sources: according to Forrester, retrieval also favours well-known entities. Companies that are rarely written about are found less often.
  • Invisible details: in an experiment by OtterlyAI, ChatGPT and other systems even hallucinated information that appeared only in schema markup and not in the text (Thomas Peham, September 2026).

Why does AI hallucination matter for AI visibility?

Visibility only helps if the details are right. A recommendation with the wrong price or the wrong service does more harm than no mention at all. Liam Dunne also points out that a model may not recommend a company if sources contradict what it says about itself (May 2026). Hallucinated URLs, moreover, send visitors to error pages.

What does this mean for your website?

Treat wrong AI statements about your brand as a measurement task:

  1. Baseline: put together a prompt set and record in a baseline measurement what AI systems say about you today. Forrester recommends questions in which your name does not appear: category, comparison and capability questions.
  2. Comparison: check every statement against your verified facts on services, prices, locations and people.
  3. Correct the sources: add missing facts as visible text, for example on a grounding page, and update outdated pages. Make sure independent sources say the same (corroboration).
  4. Check URLs: John Clark advises analysing visits from AI systems to pages that do not exist and redirecting them to matching pages (Lumar webinar, March 2026).

Repeat the measurement regularly. Substitutions shift, and every correction takes time to reach the answers.

From the term to the number

How does your company score on this factor?

The Digital Visibility Audit measures, on real buyer questions, whether ChatGPT and Google AI Overviews mention your company — and what is holding it back if they do not.

Visibility Snapshot · free

Does AI recommend you when your customers ask?

Put your customers’ question to five AI systems. In about 20 seconds you see whether you are named — and whom AI recommends instead.

  • ChatGPT
  • Claude
  • Gemini
  • Perplexity
  • Google AI Mode
Start snapshot

Free · no sign-up