Hinton urges pre-release review for advanced AI
Geoffrey Hinton argues for a medicine-style approval process for AI models. What such a review should prove, and why the US framework is voluntary.
You must treat every provider safety claim as incomplete until you know which model version was tested, by whom, within what scope and with which findings remain unresolved. A voluntary review framework cannot substitute for your own verification of the deployment assumptions and the controls that would actually constrain the model in your operational environment.
An analysis of 7 October 2026 of Geoffrey Hinton's proposal for pre-release review of advanced AI models argues that powerful AI models should undergo approval comparable to medicines before release, yet the United States operates only a voluntary pre-release framework and explicitly rules out mandatory licensing. The proposal rests on moving the decisive evidence requirement earlier: rather than relying mainly on harm identified after release, it would require developers to demonstrate beforehand that model risks are sufficiently controlled. In our assessment, this touches a real policy gap between what a credible approval process would demand and what the current voluntary US framework actually delivers. That gap matters for anyone signing off on a deployment, because the distinction between voluntary review and enforceable approval determines what you can rely on and what you must verify yourself.
What would a medicine-style review actually require?
Hinton's analogy proposes that an independent body assess whether risks are sufficiently controlled before a model reaches users. Such a process would need evidence from testing, external evaluation and incident disclosure. Critically, it would assess the full operational system—the model, the test environment, the monitoring and the conditions under which it is deployed. A benchmark score assessed in isolation does not establish how a model will behave when connected to tools and deployed in a particular operational environment.
This distinction matters because evaluation incidents have exposed weaknesses in relying on a single containment layer. When testing revealed unauthorised access, the vendor responded with measures including harder isolation, validation beforehand, real-time monitoring that can block tool calls, human alerts and pausing higher-risk evaluations until controls had improved. A credible approval process would need to examine whether such layered controls actually function in your deployment scenario, not only in the test environment.
What does the current US framework actually cover?
The United States does have a pre-release review concept through Executive Order 14409, which describes a classified benchmarking process and a voluntary framework allowing government pre-release access to certain covered frontier models. The order expressly states that it does not authorise any mandatory government licence or permission for developing, publishing or distributing AI models. That voluntary window means coverage gaps can arise: when developers decline to participate, or when the criteria and review period are inadequate, no formal authorisation requirement applies.
The European Union's AI Act sets risk-based obligations for providers, but the evidence does not identify a medicine-style, enforceable pre-release approval regime that holds back deployment of a frontier model. The Congressional Research Service notes that Congress may consider whether stronger, mandatory evaluation before rollout is needed, but that remains a policy question, not current law.
What should you verify before connecting a model to sensitive workflows?
Because the US framework remains voluntary, a claim that a model is "approved" or "safe" is not equivalent to independent, formal authorisation. You should therefore establish in your contract which model version was tested, by whom, within which scope and with which unresolved findings. You should independently verify the available evidence and deployment assumptions, particularly because a voluntary review window can leave coverage gaps when a developer declines to participate.
The following controls should be demonstrable before sensitive workflows are connected:
- Identify the model version and its lawful basis — document which model each workflow uses, when it was tested and the basis for any claims about its safety or capability.
- Obtain independent evaluation evidence — require external testing results, not only the vendor's internal benchmarks, and verify the scope of that testing against your operational environment.
- Verify the containment architecture — confirm that real-time monitoring can actually block tool calls, that human alerts function as designed and that isolation layers are harder than a single containment point.
- Test deployment assumptions before go-live — validate that the controls you rely on actually work in your environment, not only in the vendor's test setup.
- Establish ongoing monitoring and incident reporting — require the vendor to disclose incidents, model updates and changes to the tools or context in which the model runs, and maintain your own monitoring once deployment begins.
Why does a one-off approval not cover ongoing use?
Even an approval would not guarantee harmlessness and would not make oversight after the fact unnecessary. AI models change through updates, additional tools, fine-tuning and the context in which they run. A one-off stamp would not cover that evolution, which is why any review would have to be paired with continued monitoring once a model is in use, rather than treated as a final verdict. Your own assessment of the deployment environment and the power to block tool calls must remain active, not delegated to a past review.
Tooling can help you track which model version is in use, log tool calls and alert you to anomalies. What tooling cannot do is substitute for your professional judgement about whether the controls you have verified actually match the risks you face in your particular operational context. That assessment stays yours.
Sources: This article draws on reporting and guidance from heise online, The White House, Congressional Research Service, Library of Congress and Anthropic.
Written by
Marit Halversen
Covers AI governance and regulatory design, with a focus on how compliance obligations land on architecture rather than on paperwork.