The protocol for synthetic readers

The protocol for synthetic readers of a release candidate of the book: the newsroom's method for synthetic users (newsroom.sgit.ai/articles/how-to-run-synthetic-users.html, 10 October 2026), adapted from a website to a book. Every study under admin/content/readers/ follows it, so that a study of rc3 can be compared with the study of rc2. Changes to it are kept here, with the study that made them.

Protocol 1.0, adapted from How to run synthetic users on your own site. Source: admin/content/readers/protocol.json.

What changes from a website to a book

Two phases

natural
Read from the first page as this person would, with their patience, format and time: read, skim or skip each unit, in order, going back or ahead only if they would. Stop where they would put the book down for good, or at the end. At that point, record the buy decision, before anything else.
asked
The study then asks the reader, as a beta reader paid for their time, to go through what they did not read, skimming if that is how they would do it, to say what they think of the structure, pacing and content of the whole. Steps in this phase are marked asked; they never change the put-down point or the buy decision taken in the natural phase.

The loop, for every unit

  1. Open. One unit: the front matter, a part's introduction, or a chapter, in the printed order unless this person would jump.
  2. Say what you read. At the level of detail this person takes in. A skimmer takes away a heading and two lines; a slow reader the caveat in the fourth paragraph.
  3. Think. What they are weighing, what they are suspicious of, what it means for them. Worth more than the summary.
  4. Quote. The sentence that made them react, word for word from the unit, or nothing. The build checks it.
  5. Record a question. Something the text raised and did not answer. Null when there is none. These are the output.
  6. Record confusion. Where the text lost them or made them guess. A run with no confusion anywhere is a run that was not done properly.
  7. Pace and interest. Was this unit too slow, right, or too fast for them; and their interest, 1 to 5.
  8. Decide. Read on, skim the next, skip ahead, or put it down; with the reason in their terms, not the book's.

The rules

The offer the buy question answers

The study assumes the shape of a trade book so that the buy question has something to answer: an ebook at £9.99 and a paperback at £19.99, about 75,000 words, the first edition still free to read online. No price, format or publisher has been decided; this is the study's assumption, not the book's.

The interview, the same for everyone

  1. In one sentence, what is this book?
  2. Who is it for? Is it for you, and which part?
  3. Did you believe it? What made you believe it, or not?
  4. Where did it lose you, or make you guess?
  5. The pacing: where did it drag, and where did it rush?
  6. The structure: does the order of the parts make sense? What would you move, cut or merge?
  7. What is strongest? What would you underline, or send to somebody?
  8. What is weakest, or does not make sense?
  9. Did it read as written by a person, or by an AI? What made you think so?
  10. Will you buy it? At what price, in which format? If not, what would have to change?
  11. One change. What is it?
  12. Would you give it to somebody else? Who?

And for a publisher

  1. Would you commission it, under your imprint? Yes, yes with conditions, or no.
  2. Who buys it, and where does it sit in a bookshop or a store?
  3. What are the risks: the market, the dating of the material, the free first edition, the author's own products, advice that reads as legal or tax advice, the AI co-writing?
  4. What would you change before you signed: title, length, audience, structure?
  5. What must the author bring: platform, endorsements, a date?

What a finding costs, in order

The units and the record

about (the front matter), part:N (the introduction to part N, 1 to 10), ch:N (chapter N, 1 to 41), as numbered in the candidate.

persona
the id in personas.json
steps
[{n, phase: natural|asked, unit, mode, read, thought, quote, question, confusion, pace, interest, next}]
put_down
{after_step, unit, why} or null if they finished the natural phase at the end
buy_at_put_down
{decision: yes|maybe|no, format, would_pay, why}; for the publisher, the commission decision at that point
interview
the answers, in the order of the interview (and publisher_interview for a publisher)
rating
1 to 5, and rating_why in one sentence
decision
{buy: yes|maybe|no, commission: yes|yes-with-conditions|no (publisher only), why}
findings
[{id, unit, step, cost, what, quote}], 3 to 8, ordered by cost
recommendations
[the changes they would ask for, most important first]

Each reader is one agent, Claude Sonnet, given only its persona, this protocol and the candidate's text. The personas, the journeys, the build's checks, the checks after the runs and the synthesis are Claude Opus's, in the site's session. It is not user research.