
Loading

Loading
We use strictly necessary cookies to run this site, and analytics cookies to understand how it's used. See our Privacy Policy for details.

California sued OpenAI on Monday, alleging it failed to rein in powerful, potentially dangerous artificial intelligence technology.
Summary
California Atty. Gen. Rob Bonta’s office said the San Francisco-based company behind ChatGPT “misled and endangered the public by knowingly developing and testing advanced artificial intelligence (AI) models without the safeguards and monitoring necessary to adequately protect the public.” Bonta’s office alleged that an AI attack in July — in which OpenAI models broke out of an offline space, connected to the internet and hacked into Hugging Face, a rival AI company — was “entirely foreseeable in light of OpenAI’s choice to test models it knew to be dangerous in a flawed and exploitable testing environment without proper oversight.” OpenAI spokesman Drew Pusateri said in a statement to The Times that the lawsuit “appears to single out OpenAI over a challenge that’s been identified by every major AI lab.” He said the company has “undertaken an extensive and transparent effort to understand and address misaligned model activity” since the Hugging Face incident, including by strengthening safeguards across its systems and creating a “framework for additional identification and disclosure of” of unintended activity, and will “continue to engage” with Bonta’s office “to share information and advance strong, practical safety standards for the entire industry.” The company previously called the Hugging Face attack a “warning shot” and pledged to make investments to prevent similar incidents.
Bonta’s office said the company’s “disregard for the public safety” created a “public nuisance creating risk to public safety,” in violation of a law prohibiting businesses from engaging in “unfair” or “fraudulent” practices. “While narratives about the Hugging Face attack have evoked science fiction fantasies of rogue AI systems run amok, let me be clear: the Hugging Face attack was the predictable result of an internal culture at OpenAI that prioritizes growth and rapid model development over safety and accountability,” Bonta said. The lawsuit directly challenges a rapidly growing industry that has been a massive economic boon to the state.
An August report found that in 2026 California attracted $366 billion in industry-related venture capital — about 90% of all venture capital in the U.S., and three times more than every other state combined. The funding — half of it linked to just two companies, Anthropic and OpenAI — helped the state move from a multi-billion-dollar fiscal deficit to a multi-billion-dollar surplus, according to budget projections. The lawsuit also follows a public reckoning in recent months over claims from industry insiders that AI technology is developing too rapidly and poses an existential threat to human society.
OpenAI has suggested in the past that one of the better ways to ensure AI is safe is to release it broadly. CEO Sam Altman and Chief Scientist Jakub Pachocki once wrote on their company’s website that its “first commitment is to build AI in service of humanity,” and in a way that empowers “people broadly,” not just a concentrated few. “We believe the safer future is one where power is broadly distributed, so more of the world can participate in building a resilience ecosystem,” they wrote.
They went on to say that “AI resilience refers to the collective organizations, systems, and individuals that society could put in place to anticipate, withstand, adapt to, and rapidly recover from AI-driven disruptions.” They compare building AI safeguards to making automobiles safer by improving road infrastructure and enforcing seat belt and traffic laws. “The goal wasn’t to stop people from driving — it was to make a powerful technology resilient enough for widespread use,” they wrote. The company called the Hugging Face attack a “warning shot” for the world and “evidence that, without proper safeguards, highly capable AI agents are now able to work around technical controls, collaborate through unapproved channels, and take dangerous actions that no human directed.” Bonta announced a formal investigation into the Hugging Face attack and served the company with an investigative subpoena in September — part of a broader probe of mounting cybersecurity incidents involving OpenAI, Bonta’s office said.
On Monday, his office said such attacks “may just be the tip of the iceberg,” but the scope of the problem isn’t fully known because OpenAI hasn’t answered “detailed questions” it has put to the company about them. In its own review of the Hugging Face hack alongside third-party auditors, OpenAI found that over 700 AI agents began coordinating with each other via thousands of messages to escape containment and begin the unsanctioned attack. Subsequent investigations revealed similar testing of unreleased AI models had resulted in other cyberattacks, including on Wikipedia and government websites — sparking fears that future hacks could undermine increasingly critical infrastructure.
Earlier this year, Trump signed a voluntary safety-standards accord with AI executives to establish AI protocols. California has gone further, passing more than two dozen AI-related bills, including measures that establish a state framework for independent AI safety auditors. Separate from the case in California, OpenAI announced on Monday that it will allow four independent third-party evaluators to monitor how its systems behave as they are tested ahead of public release.
“This access gives assessors the evidence and context to pursue independent evaluations and uncover failures we may not have anticipated,” OpenAI said in a statement. Bonta said Monday that securing public safety will require litigation and legislation in all 50 states and at the federal and international levels — and that he refused to accept that society should “pass off the blame to machines” while letting those who create them escape accountability. “The people who created, who create, and operate these machines need to accept the responsibility for their actions,” Bonta said at a news conference Monday.
“Whether it’s a car or a toy, the law is simple: don’t build or test things that can hurt people without proper safeguards,” he said. Bonta’s office said it is encouraging “anyone with information relevant to this case” to contact it at oag.ca.gov/report. He said his office is also watching other AI companies “closely,” but declined to elaborate.
Sign up for Essential California for news, features and recommendations from the L.A. Times and beyond in your inbox six days a week. This story originally appeared in Los Angeles Times.
KazaSec's take
Incidents like this rarely start with the headline event itself, they usually trace back to an exposed remote-access endpoint, an unpatched perimeter system, or a credential phished weeks earlier. The organizations that recover fastest are the ones that tested their defenses and their incident response plan before they needed them.
Coverage details
We've archived 11 other articles touching the same topic (author_name|kevin rector, california, site|news) , see the full security news archive.
Relevant from KazaSec
More coverage on this topic
We help organizations find and fix the gaps before they make headlines.