Adrian DunkleyAI Risk Management

Monitoring and review

Make a risk alert lead to a decision

Give every threshold a definition, an owner, a fallback and an escalation action.

Four readings at 2%, 3%, 4% and 5% tell an interesting story. The question for Operations is whether a written threshold has been breached. In this practice example, the trigger is two consecutive complete readings at or above 4% and at least 500 eligible transactions in each reading. The fourth reading is the first point where escalation is due, if all four readings qualify.

Define exactly what counts

Record the numerator, denominator, coverage and source. State when missing data should trigger investigation. If the third reading is missing, the fourth alone cannot satisfy the two-reading condition. Ask the owner to agree what happens after an incomplete reading and who reviews alerts when the primary reviewer is away. HM Treasury advises monitoring “before, during and after implementation of risk treatment”. HM Treasury, The Orange Book

Use a system calculation or analyst-approved query to check the trigger. Give AI the checked figures and source notes to draft the explanation. Ask it to distinguish the observed change from explanations the analyst still has to test. Monitor the quality of both the inputs and the explanation. NIST, Generative Artificial Intelligence Profile

Handle the cases that break the rule

CaseAction
Two qualifying readings at or above 4%Escalate to the named owner.
High rate with a small denominatorRecord the data exception and check the count.
Missing surveillance dataNotify the data owner and record the gap.
Alert delivered to an absent ownerRoute to the approved fallback.

Keep the alert, the two source readings and the action record together. When the owner closes it, preserve the evidence that justified closure. If repeated false leads consume review capacity, revisit the threshold and measure what a change might miss.

Copy this prompt

Apply the supplied indicator definition to the approved readings. Show reading IDs, eligible counts, exception counts and rates. Flag incomplete and low-volume records. Mark the first point where the rule is met and identify the approved owner and action. Draft a short explanation with only supported facts. List possible causes as hypotheses with evidence to request. Do not change the threshold.

Review the rule itself

Take a sample of triggered and untriggered cases to the review meeting. Ask the owner whether the rule identified the work they intended. Record proposed threshold changes and preserve the old version for comparison.

Sources and references