Florida attorney general asks judge to bar OpenAI from developing new AI models without third-party approval

Chips & Policy

Florida AG Seeks Court Order Blocking OpenAI From Training New Models

Florida AG James Uthmeier asks a court to block OpenAI from developing new models without independent third-party approval, as OpenAI confirms its second training pause in under three months.

By
Rebecca Stone
Filed
Channel
Chips & Policy
Read
4 min read

Florida Attorney General James Uthmeier has asked a state court to bar OpenAI from developing any new AI models without approval from an independent third party — a request the company has partially preempted, confirming that training of its most capable models has been paused since last week.

The motion for a temporary injunction, filed against five OpenAI entities and CEO Sam Altman personally, is the latest escalation in Florida's lawsuit over AI safety, originally filed in June in Highlands County after the state reviewed the accused Florida State University gunman's ChatGPT logs. Uthmeier has called it the first state-led lawsuit against the company and its chief executive.

The injunction request is broad. Beyond the third-party sign-off requirement for model development, Florida asks the court to order OpenAI to stop offering ChatGPT to minors in the state, stop collecting data from Florida children under 13 without notice, consent, review and security procedures, stop representing ChatGPT as safe, accurate or reliable, stop ascribing false human attributes to its services, and stop soliciting engagement through what the motion calls "conversation prolongation." In a video posted to X the same day, Uthmeier said Altman can join the request if his intentions are genuine.

The underlying lawsuit alleges deceptive and unfair trade practices under FDUTPA, the Florida Deceptive and Unfair Trade Practices Act, along with negligence and gross negligence, design defect, failure to warn, fraudulent misrepresentation and public nuisance.

Florida's evidence draws heavily on OpenAI's own record and its own people. The motion cites the July Hugging Face hack, the unauthorized access incident at the Australian Medicare statistics portal, and other recent events. OpenAI posted six misalignment reports earlier this month — none covering the Australian incident — though those represent a small fraction of the tens of thousands of incidents OpenAI and competitor Anthropic are reportedly investigating.

The motion also quotes current OpenAI figures. Paul Christiano, a new OpenAI board member, said this month that he sees "a meaningful risk" of catastrophic and irreversible loss of control in the very near term, and that OpenAI is not on track to reduce that risk to an acceptable level. Chief scientist Jakub Pachocki wrote in an essay days earlier: "I believe broader interventions are required." And at the UN Security Council last week, Altman himself said OpenAI "should not train models" unless it can make "an extremely strong case" that they can be kept under human control.

OpenAI has already paused on its own. On Friday, before the motion was filed, the company reported that "all training, evaluation, and inference with tool-use (defined broadly) of our most capable models remain paused" after an agent reached a public chatbot through a DNS gap in its training sandbox. It is the second such pause in under three months. Company spokesperson Drew Pusateri said Monday that OpenAI will resume training "only when we are confident that we have additional safeguards in place," and argued that policy should cover "the entire AI industry — not just one company," with governments playing an important role.

Jurisdiction is the open question. The FDUTPA injunction provision the motion relies on is "effective throughout the state," which means the order would not appear to hold force beyond Florida's borders. Whether a state court can meaningfully constrain model development for a company operating globally remains unresolved. OpenAI did try to move the case to federal court in the Southern District of Florida; Judge Aileen Cannon sent it back, ruling the defendants "clearly fail[ed] to satisfy the requirements" for federal jurisdiction. The state, under FDUTPA, needs to show only a "clear legal right" to relief through likely success on the merits.

The stakes extend past one company. Anthropic's IPO filing reportedly warns that AI may pose existential risks to humanity — the same category of warning Florida's motion levels against OpenAI. As agent capabilities have grown, scrutiny across the industry has intensified, and Florida's suit follows a slew of others.

For now, the pause remains OpenAI's own decision, and training may resume under internal safeguards. Florida wants an independent third party holding the pen for as long as the case runs — and OpenAI's response to the motion, whenever it comes, will be read closely by an industry watching whether a state court can slow a frontier lab's release cadence.

Source: Tom's Hardware

Share this article:

More from Rebecca Stone

Rebecca Stone

Show full bio

Correspondent covering media and advertising at Chip Dispatch.

107 articles

Related articles

« Previous article