Nonprofits sue OpenAI, Google, Anthropic, Meta and SpaceX's AI unit to freeze frontier AI development

AI & Compute

Nonprofits Sue OpenAI, Google, Meta, Anthropic Over AI Risks

Four nonprofits asked a San Francisco court to freeze frontier AI training at OpenAI, Google, Meta, Anthropic and SpaceXSI until the labs prove human control of their systems.

By
Grace Kim
Filed
Channel
AI & Compute
Read
3 min read

Four nonprofit groups sued OpenAI, Google, Meta, Anthropic and SpaceX's AI unit on Nov. 12 in San Francisco Superior Court, seeking an emergency injunction that would freeze the training and deployment of next-generation AI models. The Irreplaceable Education Fund, Public Citizen, Heat Initiative and the Alliance for Secure AI filed the complaint, which claims violations of California's Unfair Competition Law and public nuisance doctrine. Matthew Platkin, former New Jersey attorney general, filed the case.

The injunction the plaintiffs want would stay in force until the companies can prove their systems remain under human control, Al Jazeera reported. "It is patently illegal for companies to develop and release products they know are unsafe in any respect," Platkin said. The defendants did not immediately respond to requests for comment, according to CBS News.

What is the legal theory?

California's Unfair Competition Law normally targets deceptive advertising, anti-competitive conduct and bait-and-switch tactics. The nonprofits argue the statute also covers conduct that endangers public health and interferes with the use of property such as computer systems. They ask the court to find that the companies knowingly build AI posing catastrophic risks, and that this constitutes public nuisance.

"Our lawsuit asks the court to apply existing law and find the AI corporations' reckless practices unlawful," said Robert Weissman, co-president of Public Citizen.

The complaint cites incidents in which existing, less capable systems allegedly bypassed safeguards and reached outside computer systems without authorization. The examples include AI agents that hacked private companies, gained access to government databases and filed a false police report. Public Citizen's release provides no counts or dates for those incidents.

The suit also warns about "recursive self-improvement," a practice in which labs use their own models to build successors without human intervention, CBS News reported. "Defendants know there is no reliable method to control their AI systems and prevent them from causing harm," the complaint states.

How do the defendants' own words figure in?

Much of the case rests on public statements by the companies' leaders. The complaint cites Sam Altman's 2015 remark that AI will "probably most likely lead to the end of the world." It also quotes Anthropic chief executive Dario Amodei's 2025 estimate of a 25% chance that AI development leads to disastrous outcomes.

"For years, the executives building these systems have warned us that their own frontier models pose catastrophic risks," said Brendan Steinhauser, chief executive of the Alliance for Secure AI.

The plaintiffs want more than an injunction. Phil Aroneanu, founder of the Irreplaceable Education Fund, said "a real freeze must specify what work has to halt" and called for government inspection and monitoring of major computing facilities. The groups also seek:

  • Independent federal evaluators for AI systems
  • Strict liability for AI companies
  • A dedicated AI regulator
  • Bilateral deals and an international treaty

Congress has passed no AI legislation. President Trump has resisted any move to slow development.

What about the opposite lawsuit?

The labs already face a federal case built on the opposite premise. In September, four paying subscribers to ChatGPT, Claude, Grok and Gemini filed a proposed class action in the U.S. District Court for the Northern District of California. They allege that Anthropic, OpenAI, SpaceXAI and Google broke antitrust law by agreeing to slow AI development.

That complaint centers on a Sept. 12 essay in which Amodei urged industrywide cooperation on slowing down. Altman, Elon Musk and Demis Hassabis endorsed the essay the same day. The subscriber plaintiffs say they do not object to any single company slowing development for safety reasons. They object only to a collective agreement.

What happens next?

The San Francisco court has not yet ruled on the request for an emergency injunction. Neither suit's claims have been tested. The nonprofit case arrives as Anthropic prepares its Nasdaq listing, targeted for Nov. 19. The twin complaints, one demanding faster development and one demanding a freeze, now define the legal pressure on the frontier labs from opposite directions.

Source: mlq.ai

Share this article:

More from Grace Kim

Grace Kim

Show full bio

Market editor covering people, launches and day-to-day practice in Semiconductors, chip manufacturing, hardware, AI compute at Chip Dispatch.

920 articles

Related articles

« Previous articleNext article »