top of page
Token
A chunk of text (like a word or part of a word) used by AI to understand language.
Help me explain to...
K–5th
A token is like a word puzzle piece that helps the computer read and understand sentences.
6–8th
AI breaks sentences into pieces called tokens. These can be words or parts of words.
9–12th
Tokens are the smallest units of text an AI processes. Tokenization splits language into manageable parts for language modeling.
Expeditions
K–5th
Cut a sentence into word blocks. Mix and match to see how computers “see” language.
6–8th
Play a word-chop game, split and reassemble. Relate to how AI uses sub-word tokens.
9–12th
Test prompt limits by observing token counts in AI tools like ChatGPT. Compare outputs.
Share Term
bottom of page