Human-in-the-loop is not enough. The human must govern the structure.
Requiring a human to click an approve button at the end of execution is not a safety control. It is a ritual. When AI systems operate across multiple steps, access live systems, and produce downstream consequences, governance must be built into the architecture of the workflow — not bolted on at its edge.
Key Facts
- Core failure mode
- Approval at the edge of execution, after consequences are already in motion
- HITL is not sufficient when
- Intermediate state is invisible, execution spans multiple steps, or rollback is undefined
- Blueprint principles in scope
- P1, P8, P9, P10 — delegation, approvals, system representation, steering
- The replacement model
- Governing structure: approval surfaces, intervention points, escalation tiers, and operator override
When approval becomes theatre
The HITL pattern was designed for single-step, low-stakes decisions. Applied to complex agentic workflows, it collapses under four failure modes: approval arrives after the consequential work is already done; intermediate state is invisible so the human cannot make an informed decision; there are no intervention points mid-execution; and recovery from a bad approval is undefined. These are not edge cases — they are structural properties of naive HITL design.