AI FoundationsStarter1:24

What Are Tokens?

Prefer to read?

AI breaks text into smaller pieces called tokens before it processes it.

Key ideas

One word is not always one token, and both your message and the AI's reply use tokens.

Different languages and scripts can split into different numbers of tokens, which is why tokens matter for cost and limits.

Why it matters: Every other skill rests on this: knowing how AI reaches an answer and when to check it.

Keep going