Updated 2026-07-13
learn
Token
The unit an LLM actually reads and writes — usually a word-piece rather than a whole word. "Unhelpful" might be three tokens. Models are priced and measured in tokens, and they generate text one token at a time.
Updated 2026-07-13
learn
The unit an LLM actually reads and writes — usually a word-piece rather than a whole word. "Unhelpful" might be three tokens. Models are priced and measured in tokens, and they generate text one token at a time.