A business approves an AI assistant for finding internal policies. Six months later, the assistant is also summarising customer records and recommending how staff should resolve complaints. The original approval may have been reasonable, but it says little about the additional data and decisions now involved.
An AI governance framework establishes how an organisation makes and revisits decisions about AI throughout its lifecycle. It connects policy, ownership, risk assessment, controls, evaluation, approval, monitoring, and eventual retirement. Its value becomes visible when those activities influence what a system is allowed to do and what happens when its conditions change.
The framework needs to cover the application in its workflow. The same model can support a low-consequence drafting task or contribute to a decision affecting someone’s employment. Its risk depends on the data, users, integrations, authority, and consequences of the deployment, as well as the model itself.
Establish the Framework’s Control Areas
A business framework brings policy, processes, and technical controls together around five connected areas. The table identifies what each area must produce; the sections below follow those requirements through a use case’s lifecycle.
| Control area | What the framework should require | Record supporting the decision |
|---|---|---|
| Organisation and ownership | Named human owners for systems and deployments, with cross-functional input from business, legal, compliance, security, and technical specialists. | An ownership record and defined approval and escalation authority. |
| Risk classification | Review depth and release conditions proportionate to potential harm, data sensitivity, and autonomy. | A reasoned classification and the evidence required at each gate. |
| Data and infrastructure | Authoritative sources, lineage, quality standards, privacy controls, and scoped access. | Data-flow and permissions records, supplier conditions, and access-test results. |
| Ethics, transparency, and oversight | Assessment of unfair outcomes, understandable limitations, and meaningful human review or override where required. | Evaluation findings, user guidance, decision evidence, and oversight arrangements. |
| Security and monitoring | Protection against prompt injection and other attacks, operational monitoring, and retrievable audit evidence. | Security tests, monitoring thresholds, response owners, and incident records. |
Give the Framework a Defined Scope
Start by deciding which uses the framework covers. Include internally developed applications, purchased AI-enabled software, external model services, and employee use of approved tools. Existing software can acquire AI features through supplier updates, so procurement records alone will not provide a complete view.
Policy should establish a small set of operational expectations. Examples include identifiable ownership, permitted data handling, assessment before consequential deployment, appropriate review, and a route for reporting problems. Each expectation should connect to a process someone can follow.
Make acceptable-use rules concrete: which tools and configurations are approved, which information may be entered, which uses are prohibited, and how staff request a new use. Discover shadow AI through staff reporting and existing software and procurement processes, and bring those deployments into the same inventory and assessment route. Include bots and agents whose access or actions can extend beyond a chat interface.
Avoid requiring the same evidence for every use. An assistant rewriting public website copy and a system assessing customer eligibility need different scrutiny. The framework should explain how the organisation identifies those differences and assigns the corresponding requirements.
Existing resources can help structure this work. The voluntary NIST AI Risk Management Framework supports AI risk management, while ISO/IEC 42001 specifies requirements for an organisational AI management system. They serve different purposes from legislation. An organisation can use either to inform its framework while separately establishing which laws apply.
Use NIST’s Govern, Map, Measure, and Manage functions to check the completeness of responsibilities and evidence. Where the EU AI Act applies, map the relevant risk, documentation, transparency, and other duties to the framework according to the organisation’s role and applicable dates. An internal risk label or management-system certification does not settle those legal questions.
Maintain a Record of the Use and Its Owner
An inventory entry should describe what the application does, who uses it, who is affected, and who owns the business process. Record its data sources, supplier dependencies, model or service configuration, integrations, and current deployment status. The aim is to support decisions about a real service.
For the policy assistant, the initial entry might describe an internal search and summarisation service using approved staff guidance. It should identify the source owner, the application owner, and the person authorised to approve its use. When customer records are proposed as another source, that change should reach the inventory and assessment process.
Ownership can be distributed without becoming ambiguous. The business owner is responsible for the use case and its consequences, while technical teams operate the application and specialists advise on privacy, security, and legal requirements. Record who makes the final decision at important points, especially where advice conflicts.
The AI governance operating model examines those responsibilities in detail. The framework needs the ownership record so every assessment, release, and incident has somewhere to go.
Classify Risk Through Consequences and Context
Risk classification should examine the proposed purpose, affected people, sensitivity of information, scale of use, degree of automation, reversibility of outcomes, and potential harm. These factors give reviewers a basis for deciding how much evidence and oversight are appropriate.
An internal policy assistant can still cause harm if staff rely on obsolete guidance. Connecting it to customer complaints changes the assessment further: an incorrect summary could influence compensation or the handling of a vulnerable customer. The classification should reflect that workflow rather than the supplier’s description of a general-purpose assistant.
Record the reasoning behind the classification. A label without an explanation is difficult to revisit when the application changes. Identify assumptions, such as outputs remaining advisory or users checking the original policy before making a commitment.
The classification process should allow a team to challenge an initial assessment with better evidence. A proposal may have been misunderstood, or a narrower design may reduce the consequences substantially. Keep the decision and its rationale so later reviewers can see what changed, rather than treating a risk label as a permanent property of the model.
Internal risk tiers should also remain distinct from legal categories. A business might call a deployment high risk for its own purposes without placing it in a statutory category, or encounter specific legal duties for a use it initially considered routine. The compliance requirements article explains why applicability needs its own assessment.
For example, lower-risk uses may follow a pre-approved pattern, medium-risk uses may need documented specialist review, and higher-risk uses may require explicit senior approval and stronger release evidence. Define the criteria and delegated authority rather than relying on the tier names alone. Sensitive actions such as hiring recommendations, consequential financial transactions, or changes to customer rights need review conditions reflecting their actual effects.
Translate Assessment Findings Into Controls
An impact assessment should investigate the benefits and reasonably foreseeable harms of the actual use. Include people affected by errors, the quality and authority of information, privacy, security, accessibility, and the way users are likely to interpret the output. Engage relevant process specialists and users while changes are still practical.
For the assistant, contradictory policies might require source ownership and effective dates. Sensitive customer information might require restricted retrieval and controls on logs. Unsupported recommendations might require source evidence, a narrower task, or review before staff act.
Connect each material finding to a control and a way to check it. A statement that users will exercise judgement is incomplete unless the design gives them the relevant evidence, time, authority, and escalation route. The assessment should expose where those conditions do not yet exist.
Make fairness and traceability explicit assessment questions. Examine relevant differences in outcomes across affected groups, explain the measures and limitations, and retain the evidence needed to investigate disputed decisions. For data and infrastructure, record provenance, quality requirements, and permitted access. Agents should receive narrowly scoped credentials with an appropriate lifetime and revocation process, rather than inheriting broad administrative permissions.
A compact decision record can make this connection visible:
| Finding | Proposed control | Evidence for release |
|---|---|---|
| Old policy versions appear in search | Approved-source management | Cases covering superseded guidance |
| Users can retrieve another team’s records | Identity-based access checks | Cross-team access tests |
| Summaries omit important exceptions | Source inspection and restricted scope | Representative exception cases |
The record should also identify residual uncertainty. Some risks can be reduced without being eliminated. The accountable decision-maker needs to understand what remains and whether the intended benefit justifies proceeding under the proposed conditions.
Make Release a Decision Supported by Evidence
Evaluation should examine the complete workflow, including the interface, data access, integrations, and human review. Model benchmarks can inform selection, but they cannot establish that the deployed application meets the business’s requirements.
Use cases drawn from representative work, including difficult and incomplete inputs. For the assistant, test contradictory sources, missing guidance, unauthorised requests, and questions outside its intended purpose. Define what an acceptable response looks like before interpreting results.
Include prompt injection and other plausible adversarial inputs in security testing. Test the surrounding retrieval, tool, and logging paths as well as the final answer. Define the human approval points for sensitive actions and verify that execution cannot bypass them. The generative AI article develops content and source controls, while the agent framework addresses delegated actions.
Record the configuration evaluated and any limitations in the sample. If the supplier, prompts, source material, or access settings change, reviewers need to know whether the evidence still applies. A finite test set supports a bounded judgement about readiness; it cannot establish that no unexpected behaviour will occur.
The release decision should identify the approved use, relevant restrictions, unresolved issues, accountable owner, and monitoring arrangements. Conditional approval can be useful when a narrower deployment has supporting evidence. For example, the assistant might be released for policy retrieval while complaint recommendations remain disabled.
Procurement and operations belong in this decision. Confirm the supplier terms, support responsibilities, funding, fallback process, and incident route before the business becomes dependent on the service. Approval should establish an operable arrangement as well as acceptable test results.
Follow the Application Through Change and Retirement
Monitoring should reveal whether the conditions behind approval continue to hold. Depending on the use, that can include errors, complaints, access denials, unusual activity, review effort, performance on important case types, and changes in supplier behaviour.
Track drift in relevant inputs and outcomes, including potential bias or performance degradation, against the approved baseline. Protect and retain logs according to a defined purpose so they can support investigation and applicable audit obligations. Reassess the risk profile periodically as well as after material changes; a launch approval is the beginning of operational oversight.
Assign thresholds and responses. If the policy assistant begins returning outdated guidance, someone needs authority to restrict a source, disable the feature, or move staff back to the manual process. Monitoring is useful when the signal can reach a person able to act.
Material changes should trigger reassessment even without an incident. Examples include adding customer data, enabling external actions, changing models, expanding to new users, or using outputs for a more consequential decision. The required review should follow the change’s implications, with the earlier assessment available as context.
Retirement also needs a plan. Remove access, update integrations, handle retained data, close supplier arrangements, and tell users how to complete their work. Keep decision and incident records for the appropriate period under the applicable requirements rather than leaving an abandoned service indefinitely accessible.
Introduce the Framework Through Existing Work
A business can begin with one representative use case and follow it through the proposed process. Check whether people can identify the owner, understand the assessment, obtain a decision, and respond to a plausible failure. The exercise will expose missing handoffs more effectively than reviewing policy language alone.
Integrate with existing security, privacy, procurement, change-management, and incident processes where they already work. Add AI-specific questions where needed, including uncertain output, model changes, and automated actions. Requiring teams to submit the same information repeatedly can make it harder to maintain a consistent record.
Review the framework through evidence from its use. Frequent requests for the same exception may indicate an unrealistic control or a recurring design problem. Delays may reveal unclear authority or insufficient specialist capacity. The best-practices article focuses on checking whether these governance activities function in practice.
For the policy assistant, a working framework makes the expansion into customer complaints visible before it becomes routine. It provides a route to assess the new purpose, decide what is permitted, and establish the evidence and support needed. That is the practical outcome the framework should make repeatable across the organisation.



