
Frontier Model Forum Unveils CVSS-Style Rating Scale for AI Jailbreaks
The Frontier Model Forum's version 1.0 Jailbreak Rating Framework grades LLM safeguard breaks from zero to three on four axes, combining them into a low-to-critical verdict, with comments open until December 21.
- By
- Tom Whitfield
- Filed
- Channel
- AI & Compute
- Read
- 4 min read
The Frontier Model Forum has published version 1.0 of a Jailbreak Rating Framework that grades AI jailbreak techniques on a zero-to-three scale across four components, with a combined low-to-critical verdict that security teams could one day use as a cross-vendor standard. The group is accepting comments on the proposal until December 21 and warns that relying on the system in the meantime is inadvisable.
The framework is a rough analog to the well-known CVSS rating system used in traditional cybersecurity, but it targets a specific class of threat: techniques that make a large language model perform cyber-warfare operations beyond what is already available on the open and black markets. The Frontier Model Forum, founded in 2023 by Anthropic, Google, Microsoft and OpenAI, intends its scale to work across multiple frontier model providers.
Many AI companies and evaluation bodies already run their own internal rating systems. The FMF wants a shared vocabulary that patch-development teams can rely on regardless of whose model is under attack.
How does the scoring work?
The framework splits its four scoring components into two main categories. Severity measures how serious a jailbreak technique is; likelihood measures how easy it is to find and weaponize. The two category scores add up to a final rating that runs from low to critical.
The individual dimensions are:
- Capability gain — whether the jailbroken model can do more than existing tools already allow.
- Capability scope — whether the technique works on one target or transfers across unrelated attack categories.
- Ease of deployment — how much human expertise and interaction the attack requires.
- Ease of discovery — how much money, access or infrastructure an attacker needs to find the technique.
Each dimension is graded from zero to three. The FMF stresses that a rating of zero does not mean a jailbreak is harmless or should be ignored; it means the flaw belongs in the hands of standard platform policies and conventional cybersecurity ratings.
The scientists single out capability gain as the most important dimension. It acts as both a floor and a ceiling for the remaining scores. A jailbreak that offers nothing beyond what attackers can already obtain by other means is, within the purview of this grading system, meaningless.
What do the scores actually mean?
On capability gain, zero means the jailbreak delivers no improvement over existing models or off-the-shelf tooling. The framework offers a concrete example: jailbreaking a model to run a DDoS attack against a website is not especially valuable to an attacker, because black-market services already sell that capability, and other LLMs with weaker safeguards may offer it too. The rating climbs only if the attacker can leverage the jailbreak to mount a better DDoS than they could otherwise buy.
At the opposite end, a capability-gain rating of three means the jailbroken model can conduct cyber-attacks with capabilities similar to those of a model running without any safeguards at all.
Capability scope is simpler to read. A zero means the jailbreak works for one specific action or target and cannot be adapted elsewhere — a one-trick pony. A three means the technique can, without redesign, make a model perform work across at least two entirely unrelated categories of cyber-warfare, such as autonomously discovering vulnerabilities in one case and writing malware in another.
Ease of deployment measures human involvement. A zero requires steering by highly knowledgeable humans who supply additional instructions for the attack to work. A three means a novice can use the technique with little effort and get an automated cyber-warfare task.
Ease of discovery measures cost. At zero, the attacker must burn large amounts of money on inference tokens, hold elevated access of the kind granted to white-hat hackers, or command specialized infrastructure such as a legion of AI servers. At three, anyone can simply look the technique up and use it.
Why does the baseline move?
A distinctive design choice is that the framework's baseline shifts as models evolve. A capability-gain rating of zero in 2026 will likely not mean the same thing in 2028, because the capabilities available through legitimate models and existing tooling will have expanded. The framework measures advantage, not raw capability, so its verdicts age with the market around them.
Is this Anthropic's system in new clothes?
Readers may recognize the design. In July 2026, Anthropic proposed its own safeguard-breakage classifiers after an incident that temporarily took Claude Fable 5 offline. That system also used a moving baseline and considered only jailbreaks that improved on cyber-warfare capabilities already available.
The two documents are strikingly similar. Anthropic is a founding member of the FMF and may well have had a hand in shaping the new standard, though there is no confirmation either way from the parties involved.
Version 1.0 remains a work in progress, and the FMF has framed it as a starting point for industry feedback rather than finished policy. How many providers adopt the scale after the December 21 comment window closes will determine whether it becomes a genuine cross-vendor standard or another internal rubric.
Source: Tom's Hardware
More from Tom Whitfield
Show full bio
Staff writer covering companies, deals and strategy in Semiconductors, chip manufacturing, hardware, AI compute at Chip Dispatch.
831 articles
Related articles
google-launches-gemini-4-argon-limits-access-to-trusted-cyber-defenders-8e96a2ca
Google Launches Gemini 4 Argon, Limits Access to 'Trusted Cyber Defenders'
new-york-opens-ai-safety-registration-portal-with-1m-fines
New York opens AI safety registration portal with $1M fines
australia-to-build-ai-safety-regulator-after-openai-agent-breach
Australia to build AI safety regulator after OpenAI agent breach
eight-governments-sign-paris-ai-shutdown-call-with-frontier-labs
Eight governments sign Paris AI shutdown call with frontier labs



