Dear Dario,
You published We Must Pace the Frontier today, which committed Anthropic to embedded third-party evaluators and asked governments to require every other frontier company to match. Sam Altman agreed within hours.1
I believe you’re being sincere, so I’m asking you to call for a different law, one that would actually slow things down, even though it would require real sacrifice on your part.
Any AI model a company offers to the public has to be released as open weights.
This wouldn’t cover every model you train, just the ones you make available to the public. Internal and research models wouldn’t be affected, and governments could still get access to unreleased models.
But Anthropic would have to publish Fable’s weights the day it was released, OpenAI would have to do the same with Astra, and so would everyone else.
Every regulation you’ve asked for ends in capture #
There’s no slowing down frontier models by regulation that wouldn’t lead to regulatory capture. Embedded evaluators, compute thresholds, industry coordination with antitrust waivers. All of it gets written with the help of the current frontier labs, because nobody else understands the technical details well enough to write it.
Once it’s law, it only gets more complex, because every incident adds a rule and no rule ever gets removed. The big companies can afford the compliance teams and lawyers to keep up, and each new requirement makes it harder for anyone else to catch them. Instead of slowing you down, it protects your position and profits.
Why I’m asking you #
You seem like a good and principled person, and you have a record of giving things up for what you believe. You left OpenAI to start a company with safety built in from the beginning, when the safe career move was to stay.<sup>2</sup> You’ve spent years asking for regulation of your own industry and getting called a doomer and a regulatory capturer for it.<sup>3</sup> You pushed for export controls that shrink your own market. Anthropic paid $1.5 billion to settle with authors rather than fight to the end.<sup>4</sup> And today you committed to slowing down before anyone else did.
You also had the foresight to make Anthropic a PBC (Public Benefit Corporation), so you can legally put the mission first:
The responsible development and maintenance of advanced AI for the long-term benefit of humanity.
This is exactly the kind of mission over short-term profit decision the PBC structure exists for. You remain the only person who could propose a law like this and be taken seriously, and the only one likely to actually do it.
If you really want to slow down frontier AI, call for a law that makes every publicly available model open weights. There’s nothing in it to game or dodge, even for you. Hacker News
Discuss on Bluesky 1. Politico’s coverage has Altman’s “I agree with Dario that we need to pace the frontier” and OpenAI matching the evaluator commitment.↩︎ 2. Dario, his sister Daniela, and several other OpenAI researchers left at the end of 2020 to found Anthropic. He described the reasoning in a 2023 Fortune interview .↩︎ 3. His own words from today’s essay are that Anthropic advocates for regulation “even when this gets us accused of hype, ‘doomerism’, or regulatory capture.” ↩︎ 4. Bartz v. Anthropic , the largest copyright settlement in history.↩︎