Skip to main content

How language models work

LLM (Large Language Model)

An LLM is a language model that estimates the probability of the next token for a sequence of tokens. It generates text instead of looking it up in an index.

Also: Large Language Model · Language model · AI model

Anja Miebach

Founder & Owner, CodaAI

Updated: 2 min read

An LLM (Large Language Model) is a language model whose core function is to estimate the probability that a token follows a sequence of other tokens. For the sentence opening “When I wake up in the morning, the first thing I drink is …”, a model might estimate “coffee” at 18%, “water” at 9% and “tea” at 4%. From such estimates an answer emerges word by word.

How does an LLM work?

An LLM does not look things up in an index; it generates. Its knowledge sits as model knowledge in billions of parameters that were learned from texts during training: web pages, books, Wikipedia, forums, code. Anything that happened after the knowledge cut-off is unknown to the model; for that it needs a web search, whose results are passed in as context.

Because an LLM draws probabilities, stochasticity is part of the system. The same question asked twice in a row yields two different answers. For measuring AI visibility this has one consequence: a single value says nothing; only the trend across many runs carries weight.

Why does understanding LLMs matter for AI visibility?

Anyone who understands that an LLM generates instead of looking up understands three things that count in practice. First, there is no “position 1” in an AI answer, only a probability of being mentioned. Second, the website alone does not decide; everything the model has read about a brand does, including on third-party sites. Third, content must be divisible into small, self-contained units, because the model processes passages, not pages.

What does this mean for your website?

Write so that a model can use sentences individually: clear definitions, short sentences, concrete names instead of vague umbrella terms. And do not expect a reproducible position; measure with a fixed prompt set across many runs how often your company is mentioned.

From the term to the number

How does your company score on this factor?

The Digital Visibility Audit measures, on real buyer questions, whether ChatGPT and Google AI Overviews mention your company — and what is holding it back if they do not.

Where should we send your audit?

Thank you. The CodaAI team is preparing your personal Digital Visibility Audit and will send it to you within 24 hours.