Skip to content
AIMODELRACE

Module 1 of 11 · Advanced · 10 min read

The full prompting process

Seven steps that take any task from a vague idea to a prompt you can trust and reuse.

Key takeaways
  • 1Most prompt failures are process failures: unclear goal, missing context or no testing.
  • 2Write down what 'done' looks like before you write the prompt.
  • 3Test on several realistic inputs, change one thing at a time, and keep the versions.
  • 4A prompt you rely on is software: version it, evaluate it and re-test it when the model changes.

01Why a process beats clever wording

Magic phrases come and go with each model generation. What keeps working is a process: knowing exactly what you want, giving the model what it needs to deliver it, and checking the result against something more reliable than your first impression.

The seven steps below scale from a one-off email to a prompt that runs thousands of times a day inside a product. For a quick task you might do them in your head in thirty seconds. For anything you will reuse, do them properly.

  • Define the goal and what 'done' looks like.
  • Gather the context the model can't guess.
  • Draft a structured first prompt.
  • Test it on a small, realistic set of inputs.
  • Iterate one change at a time.
  • Evaluate against criteria before you trust it.
  • Ship it as a versioned template and keep monitoring.

02Step 1: Define the goal and what done looks like

Write one or two sentences that describe the outcome, not the activity. 'Summarise this report' is an activity. 'Give the board a one-page brief they can decide from in five minutes, with the three risks that need a decision' is an outcome.

Then list the success criteria you would use to judge the output if a colleague had written it: length, audience, what must be included, what must never appear, and how you will check it. These criteria become your prompt's requirements and, later, your evaluation rubric.

Example
Goal brief (fill this in before prompting): Outcome: {{what the reader can do after reading}} Audience: {{who, and what they already know}} Must include: {{non-negotiables}} Must avoid: {{things that would make it wrong or embarrassing}} Format and length: {{shape of the output}} How I will check it: {{test, source, reviewer or rubric}}

03Step 2: Gather context

The model knows a lot about the world and nothing about your situation. The single biggest quality lever is giving it the context a smart new colleague would need: who the output is for, why it matters, the source material, constraints, and examples of what good looks like.

Gather real material rather than describing it. Paste the actual policy, the actual data, the actual previous email. If you have tried before, include what went wrong.

  • Audience and purpose: who reads it and what they will do with it.
  • Source material: documents, data, code or notes, wrapped in tags.
  • Constraints: brand voice, legal limits, tech stack, budget, deadline.
  • Examples: one to three samples of great output, or a good and bad pair.
  • History: previous attempts and why they fell short.

04Step 3: Draft a structured first prompt

Put the pieces in a predictable order so both you and the model can find them. For long inputs, put the material first and the question last, as lab prompting guides generally recommend. Use tags to separate your instructions from the content you are pasting in.

Explain the reasons behind important rules. A rule with a reason generalises to cases you did not list; a bare rule in capital letters often does not.

Example
<context> I run {{business}}. This brief is for {{audience}}, who will use it to {{decision}}. </context> <documents> {{paste source material}} </documents> <task> Write {{deliverable}}. Base every claim on the documents; if something is not covered, say so instead of guessing. </task> <requirements> - Length: {{length}} - Must include: {{must include}} - Avoid: {{avoid}}, because {{reason}} </requirements> <format> {{headings, table, JSON or bullet structure}} </format>

05Step 4: Test on a small, realistic set

Collect five to twenty real inputs before you judge the prompt: typical cases, a couple of awkward ones, and at least one that should make the model say 'I can't do that from what I have'. Run the prompt on all of them and read every output.

A prompt that is perfect on your favourite example often fails on the third. Testing on a set is the difference between a demo and something you can rely on.

06Step 5: Iterate one change at a time

When outputs disappoint, name the failure before you edit. Generic output usually means missing context or examples. Wrong facts mean missing sources. Wrong format means the shape was not specified precisely, or a schema is needed. Inconsistency across runs means criteria are vague.

Change one thing, re-run the whole set and keep notes. It is common for a change you were sure would help to make other cases worse; you only notice if you re-run everything.

Tip
Keep a simple log: version, what changed, how many test cases passed. Ten minutes of bookkeeping saves hours of going in circles.

07Step 6: Evaluate before you trust it

Turn your success criteria from step 1 into checks. Some can be automatic (valid JSON, under 200 words, includes a citation). Others need a rubric applied by a person or a carefully prompted model. The 'Testing prompts' module in this path covers golden sets, rubrics and judge prompts in depth.

Decide in advance what pass rate is good enough for the stakes. A draft-generating prompt can tolerate occasional misses because a human edits the output; a prompt that writes directly to customers cannot.

08Step 7: Ship, monitor and version

A prompt you reuse belongs in a template with named variables, a version number and a short note on what it is for and what it was tested on. Store it where your team can find it, not in someone's chat history.

Models change underneath you. When you switch models or a provider updates one, re-run your test set before assuming the prompt still works. Watch real outputs for new failure types and add them to the set.

Insight
The best prompt engineers spend more time on steps 1, 4 and 6 than on wording. Clear goals and honest testing beat clever phrasing every time.

Finished reading?

Mark it complete to track your progress, then test yourself with the Advanced Prompting quiz.