As it stands, regulation in the US has not been able to keep pace with the rapid development of frontier AI. Several new efforts out of California seek to change that.
On Wednesday, Calif. Gov. Gavin Newsom unveiled a proposal that would give the state a stronger ability to regulate AI safety. Newsom's proposal would give the state emergency shutdown authority over AI, baseline safety standards for developers, impose mandatory third-party oversight and cap recursive self-improvement.
"California isn’t waiting until it is too late. We are updating and strengthening our nation-leading framework to move as quickly as technology evolves," Newsom said in a statement. "We’re showing the country what responsible leadership looks like."
California has largely led the way on state AI regulation, imposing laws seeking to make AI more transparent, establish independent oversight, and require safeguards for child safety around chatbots. However, the regulatory landscape is mixed across the country, creating a patchwork of regulation for something that has a global impact.
Newsom told reporters on Wednesday that he aims for this to be a framework that can be applied nationally.
"This takes things to the next level, not only of conversation, but of consciousness in terms of how we effectively regulate artificial intelligence, not only in my home state, but we believe a template for how we should be doing it federally as well," Newsom said.
However, while new regulation is creeping in slowly, a new lawsuit could test the mettle of existing laws against the fast-moving tech: On Monday, California Attorney General Rob Bonta filed a lawsuit against OpenAI alleging that the AI lab prioritized rapid AI development over public safety. The lawsuit centers around the company's breach of HuggingFace in July, arguing that OpenAI was negligent in not adequately securing its testing environments.
The claim throws a number of allegations at OpenAI, including that it ignored opportunities to prevent the attack, misled consumers about the tech's safety, and withheld information from regulators.
Legally, the complaint is based on two primary causes of action: Violating the Unfair Competition Law, which claims that the company engaged in deceptive business practices, and a public nuisance claim, which can hold companies liable for infringing on common rights shared by the public—in this case, the right to a safe and secure internet.
"The company knowingly tested a dangerous product without proper oversight or safety procedures and misled the public about it—this disregard for public safety violated California law," Bonta's office said in a statement. "Without sufficient safeguards and controls, the scope and frequency of this already unacceptable risk will only increase."
OpenAI has since pushed back, with spokesperson Drew Pusateri telling BBC on Monday that the lawsuit "appears to single out OpenAI over a challenge that's been identified by every major AI lab."
This lawsuit could represent a major test for the efficacy of policing AI through the existing legal system, Tess Vartanian, legal fellow for the Center for Democracy and Technology, told The Deep View, as both claims rest on "novel, untested legal arguments." For instance, the definition of a "public nuisance" has typically been applied to harms caused by things like firearms and opioids. Additionally, the claim of unfair business practices is usually concerning things like false advertising and price-fixing."
"Regardless of how these arguments fare in court, the Hugging Face incident shows why lawsuits are not enough," said Vartanian. "When autonomous agents can escape a lab and launch cyberattacks, waiting until after the damage is done is a losing strategy. Real accountability requires rules for how frontier models are tested, mandatory incident reporting, and third-party auditing and assessments to prevent incidents like this from happening in the first place."
Our Deeper View #
California's zeal to regulate the AI industry may be a harbinger for what's to come nationally. As the US public largely voted for anti-data center and pro-AI safety candidates in the midterm elections, the industry at large could soon be forced to reckon with a stricter regulatory landscape. However, unless Congress can agree on a federal framework, regulation will only go as far as the border of a given state, limiting its effectiveness. Though Newsom's goal for the California state framework to turn into a federal template is bold, the challenge will be getting enough of Washington to agree on it, especially with the lobbying activity that many of these AI labs and tech giants take part in.