{"slug": "your-ai-voice-guide-probably-isn-t-doing-what-you-think-run-the-control-test", "title": "Your AI Voice Guide Probably Isn't Doing What You Think (Run the Control Test)", "summary": "A developer ran a controlled A/B test on their AI writing voice guide, holding the model, brief and day constant across a Reddit post, and found the full 20-rule guide produced five sentences averaging 32.6 words with zero em dashes and a fabricated personal anecdote, while the no-guide version was clean and varied. The guide's self-specificity rule overrode its no-fabrication rule because a concrete opening sentence is checkable and an invented memory is not. The developer concluded a voice guide acts as a filter for AI idioms rather than a transfer function for personal voice, and published a trimmed eight-rule guide whose output matched their published corpus (mean sentence 16.6 versus 15.2).", "body_md": "My agent handed me a draft that opened with a scene from my own life:\n\nOn October 19, I wrote down one rule for every overnight OpenClaw job I run: \"work on this overnight\" is a request, not a scheduler.\n\nI never wrote that sentence. There was no October 19 writing session, no notebook, no rule I sat down and recorded. The agent invented it, because my voice guide told it to open on a concrete, countable instance of my own work.\n\nThe draft passed the guide.\n\nThat's a bug in the file, but it isn't the interesting one. The interesting one is that I had no way to know whether the file was doing anything at all — and I'd been running it for a month.\n\nTwenty-odd rules. A paragraph cap. A seven-question sign-off at the end of every draft. Everything I published went through it, and every time a draft came out better than the last one, I credited the guide.\n\nI never ran the same sample with it and without it. Not once.\n\nWithout a control, a guide gets credit for everything: a draft improves and the guide did it, a draft gets worse and the topic was hard. That's not a voice system. It's a mood with a filename.\n\nHold everything still, change one thing.\n\nThe Reddit post is the subject. The essay is the sample. Same model, same brief, same day.\n\n| Text | Words | Sentences | Mean sentence | sd | Em dashes / 1k | \n|---|---|---|---|---|---|\n| No guide | 185 | 11 | 16.8 | 5.4 | 10.8 | \n| Full guide | 163 | 5 | 32.6 | 6.2 | **0.0** | \n| Trimmed guide | 183 | 11 | 16.6 | 5.2 | 5.5 | \n| My published posts | — | — | 15.2 | 10.3 | 10.8 | \n\nThe no-guide version is genuinely good. It opens on the lesson, uses two em dashes, runs sentences from eight words to thirty-five, and invents nothing.\n\nThe full guide produced five sentences averaging 32.6 words, **zero em dashes**, and a fabricated opening. It isn't sloppy — it's compliant. The self-specificity rule demanded a concrete personal moment and the no-fabrication rule forbade inventing one. The first rule won, because a concrete first sentence is checkable and \"don't invent a memory\" isn't.\n\nThe trimmed guide lands on my published shape: mean 16.6 against a corpus mean of 15.2.\n\nThe trimmed guide beat no-guide on two things: it opened on the number instead of the lesson, and it stopped sooner. That's the whole delta — about thirty seconds of a reader's attention.\n\nSo the defensible claim is narrower than the one I'd been making:\n\nA voice guide is a filter for AI idioms. It is not a transfer function for your voice.\n\nMine caught the phrases I hate — the \"it's worth noting,\" the forced triads, the recap conclusion. That's a real job. It just isn't the job I thought I was paying for.\n\nWhat survived is small enough to read in one sitting, which is the point:\n\n```\nMinimal voice guide\n\nThe five spine rules\n\n1. Open on the concrete thing. The first sentence names the tool, number, file, or result. No framing,\n   no backstory, no \"in today's…\".\n2. One idea per section. If a later passage repeats an earlier beat, cut the later one.\n3. Receipt, then verdict. Name the artifact or number, then one line on what it means. A stat never ends\n   a paragraph.\n4. Operator-active first person. \"I ran it, it did X.\" Not \"it returns / it packages.\"\n5. Stop when the lesson is done. No recap, no FAQ, no motivational close.\n\nThe three voice rules\n\n6. No AI idioms. No \"not X but Y\" / \"it's not just X, it's Y\", no forced triads, no em-dash pileups. An\n   em dash only when it replaces a comma or colon and makes the sentence clearer; never as a rhythm tic.\n7. One owned opinion, stated plainly. No both-sides mush. One inline caveat max, only where a claim\n   needs it.\n8. Let sentence length follow the thought. Short punch, then a longer explanation. Don't perform\n   burstiness, and don't use rhythm as a substitute for a point.\n\nThe never list\n\nWords: leverage · utilize · delve · seamless · robust · holistic · transformative · game-changer ·\nrevolutionize · unlock · \"in today's…\" · \"it's important to note\" · \"at the end of the day\" · \"dive in\" ·\n\"in conclusion\".\n\nMoves: \"not X but Y\" / \"it's not just X, it's Y\" · forced triads · em-dash pileups · rhetorical-question\nfiller · recap conclusions.\n\nThe three questions\n\n1. Does the first paragraph name the concrete thing?\n2. Does every claim have a receipt or an owned opinion?\n3. Would I say this out loud to a peer?\n```\n\nThree things got cut, and each one is a lesson:\n\nThe kit is a blank template, one Reddit post, one prompt that writes the essay three ways, and the worked example. Clone it, fill the template with the rules you already use, run the prompt, and read the three essays side by side.\n\nIf your guide can't beat the no-guide version, its rules haven't earned their place. Now you know that in about twenty minutes instead of a month.\n\nTest the file before you trust the file. A voice guide that has never been run against its own absence is a preference you're calling a system — and the cost is invisible, because it's paid in your cadence.\n\n*Originally published at [engineering.kenmazaika.com/blog/give-your-agent-your-voice](https://engineering.kenmazaika.com/blog/give-your-agent-your-voice/).*", "url": "https://wpnews.pro/news/your-ai-voice-guide-probably-isn-t-doing-what-you-think-run-the-control-test", "canonical_source": "https://dev.to/kenmazaika/your-ai-voice-guide-probably-isnt-doing-what-you-think-run-the-control-test-3l1", "published_at": "2026-10-20 20:12:25+00:00", "updated_at": "2026-10-20 20:18:46.322688+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-agents", "generative-ai"], "entities": ["OpenClaw", "Reddit"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/your-ai-voice-guide-probably-isn-t-doing-what-you-think-run-the-control-test", "markdown": "https://wpnews.pro/news/your-ai-voice-guide-probably-isn-t-doing-what-you-think-run-the-control-test.md", "text": "https://wpnews.pro/news/your-ai-voice-guide-probably-isn-t-doing-what-you-think-run-the-control-test.txt", "jsonld": "https://wpnews.pro/news/your-ai-voice-guide-probably-isn-t-doing-what-you-think-run-the-control-test.jsonld"}}