Adrian DunkleyAI Risk Management

Qualitative assessment

Use a National Agentic Risk Matrix to decide what to test

Work one failure path through exposure, agent authority, control gaps, reach, harm and recovery.

A high-level label such as “AI disrupts public services” is hard to test. Write down what starts the failure, what the agent can do and what would stop it. The National Agentic Risk Matrix (NARM) gives you six questions to ask before you put that path on a heat map. Adrian Dunkley, National Agentic Risk Matrix

Rate a path to harm

Use low, medium or high for each factor. Record the evidence beneath the rating. Exposure asks how often an opening occurs. Agent authority asks how much the system can influence the result. The control gap asks whether a tested safeguard can stop the harm. Take the lowest of those three to rate likelihood for that path.

Severity is high if harm is high, or if reach and recovery difficulty are both high. Otherwise it is medium if either harm or recovery difficulty is medium or high. The remaining cases are low. Score a different route to the same harm separately. Take the higher likelihood rating when deciding what to test first. I use one rule when reviewing the grid. “Treat the ratings as priorities for testing.” Keep numerical probabilities in a separate analysis. Adrian Dunkley, National Agentic Risk Matrix

Worked example from the port scenario

FactorPractice ratingReason
ExposureMediumAn occasional outage creates a backlog.
Agent authority and control gapHigh and highAgents can resubmit at scale and duplicate checks fail after restart.
Reach, harm and recoveryMedium, medium and mediumMultiple districts face delays and several teams must clear the backlog.

The example lands at medium likelihood and medium severity. Ask the port owner to demonstrate whether duplicate detection survives a restart. If it passes a relevant test, revisit the control-gap rating. If staff can bypass the check by approving the same filing manually, score that route separately. Adrian Dunkley, National Agentic Risk Matrix

Copy this prompt

Using the National Agentic Risk Matrix rules and the approved scenario notes below, identify one path to harm. Propose a low, medium or high rating for each of the six factors. Cite the source for each rating and mark missing evidence. Apply the NARM likelihood and severity rules explicitly. List one alternative path and one test that could change the priority. Present the recommendation for the service owner to review.

Pair the matrix with a cost estimate

Use the original NARM worksheet and scenario table to document the rating. If the owner needs to compare funding options, move from the rating to a FAIR-AI estimate with separately sourced frequencies and losses.

Sources and references