What are tokens? (and why your AI bill is measured in them)

Tokens are one of those terms you can happily ignore right up until you're looking at a bill, or wondering why a long document made an AI tool slow down and start losing the thread. Both come back to the same unit.

What a token is

Models don't read letters or words. They read tokens — chunks that are usually a whole common word, or a piece of a longer one.

"The invoice is overdue" is about five tokens. A rarer word like "reconciliation" might split into three or four on its own. Punctuation, spaces and line breaks all count.

The useful conversions:

Why tokens show up twice

In what you pay. Usage-based pricing counts tokens in and tokens out, with output typically costing more than input.

In what fits. The context window — everything the model can consider at once — is measured in tokens too. Fill it and the earliest material drops out of view.

So a long attachment costs you twice: money, and room. It's the same constraint wearing two hats.

An Australian small-business example

A Newcastle logistics firm sets up an assistant to answer questions about their operations manual. To be safe, they attach the entire 180-page manual to every conversation.

Each question now sends roughly 90,000 tokens before anyone types anything. The answers are slower, more expensive, and — counter-intuitively — less accurate, because the relevant paragraph is competing with 179 pages of material that isn't.

Splitting the manual by section and attaching only the relevant one cuts the cost dramatically and improves the answers. Less really is more here.

When to care, and when not to

For a team of ten using AI through normal subscriptions, tokens are almost irrelevant to your budget. The subscription covers it, and any time saved dwarfs the difference.

Tokens start mattering when:

The practical takeaway

Don't optimise tokens for their own sake. Do develop one habit: send the relevant part, not everything you have.

That single habit reduces cost, improves accuracy and avoids context problems simultaneously — which is unusual, because those three normally trade against each other.

Frequently asked questions

How many tokens is a page?
Around 500 for a typical A4 page of prose. A 20-page report is roughly 10,000. Spreadsheets and code run higher per visible character, because numbers and symbols split into more tokens than ordinary words.
Do I pay for what I send as well as what I get back?
Yes, on usage-based pricing — input and output are both counted, usually at different rates with output costing more. On a flat monthly subscription you're not counting tokens directly, but limits still apply behind the scenes.
Why does attaching a long document cost so much?
Because the whole document is sent with the request, and often re-sent as the conversation continues. A 100-page attachment discussed over twenty exchanges can be counted many times over. Attaching only the relevant section is both cheaper and more accurate.
Is it worth optimising for tokens?
Not for most businesses at typical volumes — staff time is worth far more than the difference. It becomes worth attention when you're running something automated at scale, where a small per-request saving multiplies.
Do other languages use more tokens?
Generally yes. English is the most efficiently tokenised, so the same meaning in another language often costs more tokens. Worth knowing if you operate across languages.

Put this to work

Ad On Group runs AI training and enablement for Australian teams through Ad On AI — a three-month, self-paced program that takes non-technical staff from their first prompts to working AI agents.

Talk to us →

Keep reading

← All resources