What is a system prompt?

Most teams using AI have the same experience: it's genuinely useful, but they find themselves typing the same preamble every time. "Write in Australian English." "We're a B2B business." "Don't use exclamation marks." "Keep it under 200 words."

A system prompt is where those instructions go so you stop repeating them.

How it differs from what you type

Your prompt is the request. The system prompt is the standing brief that sits behind every request — read by the model before it sees your message at all.

It's the difference between telling a new starter the house rules on their first day and re-explaining them at the start of every task. The rules haven't changed; you've just stopped paying the cost of repeating them.

What belongs in one

What doesn't belong

An Australian small-business example

A Perth building supplies company has four staff using AI for customer emails. Each writes differently, so the outputs vary — some too casual, one prone to American spelling, another producing walls of text.

They write a shared system prompt: Australian English, short paragraphs, no exclamation marks, always offer a phone call as the next step, never quote a price without checking, sign off with the team name.

The variation collapses immediately. Not because anyone got better at prompting, but because the standing rules stopped depending on whether each person remembered them at 4pm.

Writing a good one

Start from output you didn't like. Every time the AI produces something slightly wrong — too formal, wrong spelling, too long — that's a candidate rule. Add it once and the correction becomes permanent.

Be concrete. "Be professional" gives the model nothing. "Write like you're emailing a busy tradesperson: short sentences, no jargon, get to the point in the first line" gives it something to act on.

Then review it every few months. System prompts accumulate rules written for problems that no longer occur, and each one costs a little clarity on everything else.

Why this is the highest-leverage change

Better prompting is a skill each person has to learn individually. A system prompt is a fix written once that raises the floor for everybody — including the people who will never get particularly good at prompting and shouldn't have to.

If a team is getting inconsistent AI output, this is almost always the first thing to fix, and almost always cheaper than whatever else is being considered.

Frequently asked questions

Where do I put a system prompt?
It depends on the product. Most business AI tools expose it as 'custom instructions', 'project instructions' or a settings field. In team plans an administrator can often set one for everybody, which is where the real leverage is.
How long should it be?
Long enough to cover what's genuinely always true, and no longer. A focused half-page beats three pages of everything anyone could think of — the model has to weigh all of it against every request, and padding dilutes the parts that matter.
Does a system prompt use up the context window?
Yes — it's included in every request. That's another argument for keeping it tight. A bloated system prompt costs you room on every single conversation.
Can it stop the AI making things up?
It helps, and it's worth including an explicit instruction to say when it doesn't know rather than guess. It reduces the problem rather than removing it, so the review step still matters.
Should each team have its own?
Usually yes. Finance and marketing want different defaults. Shared company-wide rules (what's off limits, what tone) plus a team-specific layer works better than one prompt trying to serve everyone.

Put this to work

Ad On Group runs AI training and enablement for Australian teams through Ad On AI — a three-month, self-paced program that takes non-technical staff from their first prompts to working AI agents.

Talk to us →

Keep reading

← All resources