Separation of duties in autonomous AI has become a design question
New governance frameworks and the CNIL/CIANum note show that separation of duties in agentic AI is a hard safety and accountability requirement.
You must now design autonomous AI workflows so that no single agent holds data access, analysis, approval and execution together. Separation of duties in agentic systems is a documented safety and accountability requirement, not an optional refinement.
The prompt is an analysis of 28 August 2026 of separation of duties in agentic AI workflows, which argues that governance frameworks and regulatory guidance now treat task compartmentalisation as a binding design constraint rather than an architectural preference. The analysis draws on an autonomy framework that distinguishes between what an agent can technically do and what an organisation permits it to do per workflow, alongside practical engineering guidance for production agent systems. In our assessment, this marks a shift in how you must document and defend autonomous AI deployments: the division of labour between agents, human oversight and policy engines has become an explicit governance object that regulators and auditors will expect to see mapped, tested and logged.
What does separation of duties mean in an agentic context?
The classical principle of separation of duties prevents any single actor from holding all effective powers over a transaction or decision. In autonomous AI, this translates to a deliberate constraint: no single agent should be able to access data, analyse it, approve an action and execute it without intervention or external policy control.
A formal autonomy model makes this division explicit. An agent may have broad technical capabilities, but per workflow it is assigned a bounded autonomy level that determines whether it only prepares recommendations, may also analyse options, or may execute only after human or policy-based approval. That autonomy level becomes a documented choice, separate from the raw capability of the model itself. The effect is to turn compartmentalisation from a design preference into a verifiable governance variable.
Which concrete controls do the guidelines now require?
- Define autonomy levels per workflow — document which tasks each agent may carry out independently and which require human or policy-based approval, distinct from the agent's technical capabilities.
- Implement single-responsibility agents — design each agent to perform one task; do not allow a single agent to handle data access, analysis, approval and execution in sequence.
- Separate workflow logic from tool execution — keep the logic that orchestrates steps distinct from the tools and services that carry them out, and manage prompts and policies externally rather than embedding them in the agent.
- Partition memory and data access per process — ensure each agent sees only the data it needs for its assigned task, and isolate memory stores by process and agent identity.
- Log and reconstruct complete decision chains — record which agent or human took which step, with which data, under which authorisation, so the entire workflow can be audited and traced.
What failure modes does this architecture prevent?
- Uncontrolled error cascade — when one agent holds all powers, a single mistake or misuse can propagate through the entire workflow without checkpoint or reversal.
- Unclear accountability for decisions — when multiple agents and external services are involved, traceability breaks down unless roles and data flows are formally partitioned and logged.
- Unauthorised data access and retention — agents that can access, analyse and execute without compartmentalisation may retain or infer personal data beyond what their assigned task requires.
- Hidden policy and prompt injection — when decision rules are embedded in the agent rather than evaluated by an external policy engine, they cannot be inspected, versioned or overridden without retraining.
- Loss of human oversight at scale — autonomous workflows without formal autonomy levels and checkpoints tend to accumulate unsupervised decision-making as systems are extended to new tasks.
How does this change your audit and compliance posture?
Regulatory guidance from 2025 and 2026 now expects you to demonstrate that separation of duties is not a side effect of your architecture but an intentional design choice. You must be able to show which agent or human took which step, with which data and under which authorisation. That means maintaining a formal autonomy model per workflow, documenting the role of each agent and the policy rules that govern approval and execution.
The practical effect is that you cannot treat autonomous AI as a black box that 'simply does its job'. You must map the division of labour explicitly, test that agents respect their assigned autonomy levels, and log the complete decision chain so that auditors and regulators can verify the separation. This is not a compliance checkbox; it is a design requirement that shapes how you build and operate the system.
What tooling can support this, and what remains your responsibility?
Verification layers and policy engines can make the division of tasks visible and enforce compartmentalisation at the technical level. External policy evaluation, memory partitioning, sandboxing and audit logging are all tooling problems with established solutions. What tooling cannot do is decide which tasks an agent should carry out independently, which require human approval, or how to weigh the risks of autonomous action against the benefits of speed and scale. That judgement remains yours. The frameworks and guidelines make clear that separation of duties in autonomous AI is now a design variable you must set deliberately and defend in writing. The tools can help you implement and verify that division; they cannot replace the professional assessment of where the line should be drawn.
Sources: This article draws on reporting and guidance from arXiv, CNIL and Insideprivacy.
Written by
Marit Halversen
Covers AI governance and regulatory design, with a focus on how compliance obligations land on architecture rather than on paperwork.