Artificial Intelligence (AI) - Record
Token
(Ai)
A small unit of text that an AI model reads or writes, often part of a word
What's it for?
Provides the small text pieces an artificial-intelligence model reads and writes when processing language.
For example…
A long policy pasted into a chat may use thousands of tokens, leaving less room for the model's reply inside the context window
A long AI prompt consumes thousands of tokens because the model breaks sentences into smaller text chunks rather than treating each whole word as one unit
Think of it like…
Pieces of firewood cut to the right size to fit into a stove