{"slug": "ai-the-great-filter-is-can-you-describe-it", "title": "AI - The Great Filter is \"can you describe it\"", "summary": "A product manager argues that AI cannot replace PMs because their role relies on judgment and taste, but this defense reveals a failure to codify standards as developers have. Developers have built infrastructure like type systems and test suites to automate verification, while PMs have kept their knowledge in their heads, leaving nothing for AI to inherit. The author warns that without rigorous, written standards, PMs will be left behind as AI advances.", "body_md": "# AI - The Great Filter is \"can you describe it\"\n\n### Devs codified \"good looks like\" into infrastructure. We PMs codified nothing, we call that judgment and taste and think it's an advantage. It's not.\n\nThe PM discussion about AI in 2026 comes down to the same conclusion:\n\n**AI can’t do what we do because what we do is judgment, taste, the art of product.**\n\nThinking about this deeply, the defense is actually an admission.\n\nThe scene: an experienced high quality PM tells me (and I concur) that autonomous agents in his work make no sense. Why? Because he needs to judge the results before he enters the meeting.\n\nA developers code “simply” has “to work”, the PM has to convince.\n\nTo make sure that their software works, devs have built tools since decades that automate verification steps.\n\nAs PMs, meanwhile, we can’t make up our minds: If the boss comes with opinion, we counter “data driven, science”. Once AI comes around the corner with data, we counter with “judgment, taste, art”.\n\nThe metric that makes a PM a good AI augmented PM is not “I use a ton of skills” but “I can describe what good looks like” and “I can describe how things are connected”.\n\nIf we had done this for years, rather than declaring our role is so different, so much more than a glorified project manager, we would have already developed the tools that make us even better with AI. That’ll be the next step. Not trivial skills that “write some PRD”, “do some market research”. And some are already figuring it out.\n\n## The infrastructure devs built\n\nSoftware developers spent sixty years codifying the standards for “good” out of human heads and into machinery. Type systems. Test suites. Schemas. Linters. Formatters. ArchUnit rules. Performance budgets. Bundle size guards. Pact contracts. SAST. CODEOWNERS. Feature flags. ADRs. SBOMs. Each describing a piece of what the senior engineer used to have on their in their mind, and now lets them hand it over to an agent. When an agent ships code, fourteen layers of codified standards do their work before a human opens the diff. The “taste” is in the machinery. While it hurts the old school engineer, the ones embracing the genie are thrilled.\n\nProduct management did the opposite. We kept it all in our heads. We never had a clear body of knowledge, we never had a clear education path, most of us transitioned into the role from the side. We rebuilt from scratch with each new team. The literature? Give me a break. Marty Cagan is more aspiration than description of what works. “Empowered. Transformed. Inspired”. Cool, aspirational, but hardly something that helps steer an agent. We invented frameworks that sounded like standards — JTBD, OST, RICE, ICE, OKRs — but they were vocabularies. A PRD can be written in perfect JTBD vocabulary and still be wrong. A schema check can’t be.\n\nThe same job. Twenty-five years of not doing it.\n\nWhen a PM says AI can’t replace what we do because in the end all of it is judgement or taste, experience, probably 10% are. The other 90% are laziness.\n\n→ Our standards were never written down.\n\n→ They were never written down because we never made them rigorous enough to write down.\n\n→ Only one or two people per team know them.\n\n→ When they leave, the standard leaves.\n\n→ When AI arrived, the standard couldn’t be handed over because there’s nothing to hand.\n\n→ Therefore, AI can’t do what we do.\n\nAnd while every word is true, every word is also an admission.\n\nAnd, yes, while there is taste and judgement needed: How many people in the company need that taste and judgement?\n\nBasically, product never decided if it wants to be art or science and we weasel around that decision and use whatever fits us. Now that bites us in the back.\n\nThe dev version of the same sentence, that AI can’t replace what we do, there’s an architectural piece, a correctness piece, a design piece, is backed by ArchUnit, the type system, the test suite, formal review. It’s based on systems and their boundaries. And, yes, of course, also developers feel sorrow over the lost value of 90% of their skills. But our “this can not be replaced” is based on no work and on no system. The moment we let Claude Code run over our context, it finds a ton of noise next to the signal and we spent a lot of time creating that noise. and most of it is vanity, not value.\n\n**Can it be finished? No way. Devs are sixty years in and still do reviews in their heads. Finish is not the goal.**\n\n**The question is: did we start.**\n\n**We didn’t.**\n\n**And now we use the not-starting as our differentiator.**\n\n## Human exceptionalism as cover\n\nWe didn't write it down. So we pointed at the people who knew it. They became the brand. Judgment. Taste. Vision. Art.\n\nThe ethereal words work as the moral high ground because **they can’t be checked.** A standard that can be described can be checked and then enforced, automated, transferred, scaled, and held against the holder.\n\nIf you don't describe it, you can't be checked. You’re hiding.\n\nHuman exceptionalism in product management is basically the cover we’re hiding behind. You can’t audit us, because what we do isn’t auditable. The unauditable part is a fact about us, not about the work. The work is auditable. We never built the audit.**I call BS. So much of what we do can be checked.** So many implicit decisions can be made explicit, are detectable by AI. So little of what we create is signal, so much is noise. And the AI is really good in figuring that out. Most of the noise is vanity, wording that does not matter and an excuse.\n\n## The cultural reflex\n\nSoftware developers treat a lack of formal definition as a problem to solve. **As Feynman says about social sciences, he would say about us: “They don’t do the hard work”.** We don’t have a way to check this, let’s build one. That has brought progress to a thousand industries. It also makes us more repeatable. Hmm.\n\nProduct managers treat a lack of formal definition as evidence of cognitive superiority. You can’t check this, it’s judgment. That sentence has shipped careers forward, not much else.\n\nThe difference between the two disciplines is not tech but culture. Devs externalize and scale. They want to automate. PMs internalize and gatekeep. As long as the work was rare and slow, gatekeeping was a nice position be in. AI produces a hundred plausible artifacts a day. Gatekeeping doesn’t help any longer. The Mexican standoff between the disciplines that AI triggers, won’t allow for that “moat”. Devs never saw the value of esoteric, elitist PM talk. Their patience will get bigger. Will the product engineer come from the dev or the PM side? I guess both, but only those who embrace “describability”.\n\n## Every “we need judgment” sentence is an infrastructure question\n\nThere’s a translation available, and almost no PM team is using it.\n\n“We need judgment about what a strong PRD looks like.” → A checklist, a worked-example library, a counter-example library, a schema-of-thought. It can be built in a quarter. A check against decisions, strategy, available tech, customer knowledge etc. None of that is abstract and none of that can not be described.\n\n“We need taste about what counts as a real customer insight.” → A definition of evidence, a magnitude threshold, a recovery test (can the customer’s actual phrasing be reconstructed from the synthesis?), a rejection library. It can be built in a quarter.\n\n“We need judgment about which strategic options to pursue.” → A set of forced explicit trade-offs, a reversibility classification, a pre-mortem template, a stakeholder-room simulator. Can be built in a quarter.\n\nNone of these need AI to be useful. But all of them make AI useful when it arrives. And they boost you, who made them describable. They make the team better in the meantime. They make the senior PM scalable instead of bottlenecked.**The ultimate PM skill therefore is not taste but to be able to describe what we hide behind taste.**\n\nThe reason most teams haven’t built any of this isn’t that it can’t be built. It’s that building it would expose how much of the previous “judgment” was vagueness. Codifying a standard forces a team to find out it never agreed on it. Vagueness is comfortable. Standards are expensive. Most teams choose comfortable. Then they call the comfort taste.\n\nTo be concrete: My insanely great Marzocco machine is nit great because an esoteric PM has singular judgment and taste, but because the Marzocco has accumulated ca. a hundred patents that keep the temperature more constant than in other machines during brewing and a design language that is not esoteric but very well described. None of that is abstract taste. And if you talk to the people at Marzocco they might not tell you everything but they can describe every little bit that makes their machines unique. a Marzocco looks like art but is hard science and engineering.\n\n## The guild defense\n\nThe political content of the taste discourse in 2026 is straightforward.\n\nPMs claiming taste, judgment, art against AI are mostly not protecting craft. They’re protecting their position as the only person in the room who knows what good looks like. AI threatens the monopoly, not the work.\n\nA team with a codified PRD standard doesn’t need the senior PM in every PRD conversation. A team with a customer-insight rejection library doesn’t need the senior PM in every synthesis review. A team with a strategy-doc schema doesn’t need the senior PM as the single authority on whether a strategy doc is finished.\n\nFor the team (and for the company) that’s improvement and progress. For the discipline that’s improvement. For the individual whose career was based on being the gatekeeper and the bottleneck it isn’t.\n\nThe taste claim defends the gatekeeper, not the work and certainly not the product. AI doesn’t care about gatekeepers, which is why the defense becomes useless.\n\n## Stop claiming what you don’t have\n\nThe change is small and can be done now.\n\n**Stop saying “we need judgment” to protect yourself from what AI will bring along anyway. Start saying “we need a checklist for this artifact type that captures what we used to mean by judgment.” Build it. Check the agent’s output against it. Update it when the check misses things.**\n\nDevs externalized their judgment over decades until judgment was the test passed. That’s not a loss of taste. That’s taste codified. The senior engineer’s taste is written into the test suite, scaling to a thousand engineers and ten thousand agents.\n\nWe can do this. We have to. Others will do it without asking. It’s not that hard.\n\nThe reason it hasn’t been done is institutional, not technological. The institution preferred to be indispensable rather than scalable. AI made that preference unaffordable.\n\nWhen Brian Chesky trusted “product” as a disciple and gave up after not seeing the results, that was a first sign of PMs not wearing clothes. It doesn’t matter that much if Brian Chesky was right in every detail. But AI will bring the verdict.\n\n“We need judgment” is a confession. Treat it as one. Build the thing the confession admits we never built.", "url": "https://wpnews.pro/news/ai-the-great-filter-is-can-you-describe-it", "canonical_source": "https://intentful.ueberproduct.de/p/ai-the-great-filter-is-can-you-describe", "published_at": "2026-06-09 12:52:48+00:00", "updated_at": "2026-06-19 13:09:31.732813+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-agents", "developer-tools"], "entities": ["Marty Cagan"], "alternates": {"html": "https://wpnews.pro/news/ai-the-great-filter-is-can-you-describe-it", "markdown": "https://wpnews.pro/news/ai-the-great-filter-is-can-you-describe-it.md", "text": "https://wpnews.pro/news/ai-the-great-filter-is-can-you-describe-it.txt", "jsonld": "https://wpnews.pro/news/ai-the-great-filter-is-can-you-describe-it.jsonld"}}