Skip to main content

How language models work

Chunking

Chunking is the splitting of a text into small, self-contained sections (chunks) that an AI system stores, compares and uses in answers individually.

Also: Chunks · Text segmentation · Parsing & extraction

Anja Miebach

Founder & Owner, CodaAI

Updated: 1 min read

Chunking is the systematic splitting of texts into small sections that an AI system processes individually. After parsing — extracting and cleaning the raw text from a web page — the content is cut into chunks, each chunk is translated into a vector (embedding) and stored. When a question arrives, the system does not search for matching pages but for matching chunks.

How does chunking work?

The simplified processing chain of an AI system has six steps: collecting data sources, parsing and extraction, chunking, embeddings, storage in a vector database, retrieval and answer. Chunking sits in the middle and determines which unit is compared later. Some systems cut by fixed length, others along headings and paragraphs. In both cases the same applies: a chunk is evaluated without the rest of the page.

Why does chunking matter for AI visibility?

Because AI systems extract passages, not pages. A paragraph that is only understandable with the context of the previous three paragraphs loses the comparison as soon as it stands alone. A paragraph that answers a question completely wins, even on an otherwise mediocre page. That is why the rule “Optimize for pages to rank and passages to be relevant” applies in GEO: the page has to rank, the passage has to convince.

What does this mean for your website?

Write so that each paragraph is a self-contained answer on one topic and each sentence remains understandable without context. Avoid references such as “as described above”. Put the core statement first (Bottom Line Up Front). What this looks like in practice is described under semantic chunking.

From the term to the number

How does your company score on this factor?

The Digital Visibility Audit measures, on real buyer questions, whether ChatGPT and Google AI Overviews mention your company — and what is holding it back if they do not.

Where should we send your audit?

Thank you. The CodaAI team is preparing your personal Digital Visibility Audit and will send it to you within 24 hours.