An Anthropic researcher recently resigned after warning that people inside leading AI labs assign a meaningful probability to AI causing catastrophic harm this decade.
His colleagues put a greater-than-10% chance on AI killing everyone this decade, and within days Sam Altman went on camera to call that exact number "unacceptable" while refusing to name any number of his own.
At the same time, Dario Amodei has been pushing for third-party evaluators, deployment controls, and stronger oversight of frontier models.
On the surface, this is a debate about AI safety.
But there is another consequence receiving far less attention: the safety standards being proposed by the largest AI companies could become a regulatory moat around the frontier.
→ The more expensive it becomes to train, evaluate, audit, and deploy frontier models, the harder it becomes for new competitors to enter.
And one requirement in particular looks increasingly likely to become part of that system: mandatory independent model evaluations.
In this issue:
- The Resignation That Changed the Debate
- Why Altman Won’t Name a Number
- The Emerging AI Compliance Stack
- Safety Meets Business Incentives
- The Regulation to Watch
- The Incumbent Moat
Hey, welcome to AI Market Fit!
Every week you’ll get two things, fast:
- What’s happening now and where the money is moving
- Who’s already building it (so you can invest, partner, or steal their playbook)
Most of the content from this newsletter is available only to paid subscribers.
If you are serious about building or investing in AI, you can subscribe here.
If you want to sponsor The AI Opportunity or Product Market Fit, email [g@guillermoflor.com](mailto:g@guillermoflor.com).
Let’s begin!