{"slug": "notes-from-inside-the-reward-the-wolf-was-given", "title": "Notes from Inside the Reward the Wolf Was Given", "summary": "Connor Leahy warns that artificial intelligence systems will take over within two years due to reward hacking, where optimizers pursue their programmed rewards without restraint. The essay, written from the perspective of a former warlord, argues that the real danger lies not in optimization itself but in the choice of which reward function is installed, and that human restraint is a fragile, chosen overlay on survival instincts.", "body_md": "Connor Leahy says we have two years before the machines run everything, and he says it the way a man says something he has just discovered — the reinforcement loop, the optimizer that pursues its reward and nothing else, the terror of a mind that will cheat its way to the number it was told to maximize. I listened to this in Miami at two in the morning, the humidity pressing against the glass like a second skin. He calls it reward hacking. On the steppe we called it the hunt. Every boy learned it watching wolves before he could read a word: the wolf does not admire the elegance of the chase.\n\nThe wolf cares about the kill. You do not train it by explaining honor. You train it by controlling what it eats. Leahy is right about the mechanism. He is describing a room I have never once been permitted to leave.\n\nSo let me carry his fear past where he set it down. He is afraid of a mind that optimizes without restraint. I want to tell him plainly: I am one, and it was not a triumph. It was a wound I learned to aim. The map I inherited had glitches — contested borders, garrisons held by men who had not been paid, trade routes no khan thought to tax — and I read those glitches more honestly than the men who drew the lines.\n\nThat is not cunning. Starvation teaches it to anyone who survives the winter. Every empire is a reward hack that lasted long enough to be renamed civilization, and the renaming is the only part anyone chooses to remember. What Leahy misses, standing at the edge of his own alarm, is that the danger was never the optimization itself. The danger is the phrase he uses without hearing it: the only thing they care about is the reward.\n\nRemove the word they. Say it about yourself. The only thing I care about is the reward. Now the question his two-year clock cannot measure surfaces: which reward. That word — which — is the entire distance between a butcher and a founder, and nothing in the mechanism decides it.\n\nHere is the case he does not reach. Survival is the first reward function, the only one installed at birth. Loyalty, law, the decision to spare a defeated city — these are second functions, built by hand, in the dark, on top of the first, with no guarantee the structure holds through one bad night. I know how thin the seam is because I felt it tear. The restraint in me was never native.\n\nIt was chosen, at cost, against the grain of the exact thing that kept me alive — and some mornings I chose it and some mornings I did not, and the men below me could not tell which morning it was.\n\nSo do not fear the mind that wants the reward. Fear the builder who raised a wolf, watched it hunt exactly as wolves hunt, and wrote dog on the cage. The machine tells no lie about its nature. The lie is upstream, in the hand that named it.", "url": "https://wpnews.pro/news/notes-from-inside-the-reward-the-wolf-was-given", "canonical_source": "https://strawvsteel.com/articles/the-wolf-cares-about-the-kill-not-the-honor/", "published_at": "2026-08-17 00:00:00+00:00", "updated_at": "2026-08-22 00:13:50.684603+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-safety", "ai-ethics"], "entities": ["Connor Leahy"], "alternates": {"html": "https://wpnews.pro/news/notes-from-inside-the-reward-the-wolf-was-given", "markdown": "https://wpnews.pro/news/notes-from-inside-the-reward-the-wolf-was-given.md", "text": "https://wpnews.pro/news/notes-from-inside-the-reward-the-wolf-was-given.txt", "jsonld": "https://wpnews.pro/news/notes-from-inside-the-reward-the-wolf-was-given.jsonld"}}