Qualitative assessment
Use a National Agentic Risk Matrix to decide what to test
Work one failure path through exposure, agent authority, control gaps, reach, harm and recovery.
A high-level label such as “AI disrupts public services” is hard to test. Write down what starts the failure, what the agent can do and what would stop it. The National Agentic Risk Matrix (NARM) gives you six questions to ask before you put that path on a heat map. Adrian Dunkley, National Agentic Risk Matrix
Rate a path to harm
Use low, medium or high for each factor. Record the evidence beneath the rating. Exposure asks how often an opening occurs. Agent authority asks how much the system can influence the result. The control gap asks whether a tested safeguard can stop the harm. Take the lowest of those three to rate likelihood for that path.
Severity is high if harm is high, or if reach and recovery difficulty are both high. Otherwise it is medium if either harm or recovery difficulty is medium or high. The remaining cases are low. Score a different route to the same harm separately. Take the higher likelihood rating when deciding what to test first. I use one rule when reviewing the grid. “Treat the ratings as priorities for testing.” Keep numerical probabilities in a separate analysis. Adrian Dunkley, National Agentic Risk Matrix
Worked example from the port scenario
| Factor | Practice rating | Reason |
|---|---|---|
| Exposure | Medium | An occasional outage creates a backlog. |
| Agent authority and control gap | High and high | Agents can resubmit at scale and duplicate checks fail after restart. |
| Reach, harm and recovery | Medium, medium and medium | Multiple districts face delays and several teams must clear the backlog. |
The example lands at medium likelihood and medium severity. Ask the port owner to demonstrate whether duplicate detection survives a restart. If it passes a relevant test, revisit the control-gap rating. If staff can bypass the check by approving the same filing manually, score that route separately. Adrian Dunkley, National Agentic Risk Matrix
Copy this prompt
Using the National Agentic Risk Matrix rules and the approved scenario notes below, identify one path to harm. Propose a low, medium or high rating for each of the six factors. Cite the source for each rating and mark missing evidence. Apply the NARM likelihood and severity rules explicitly. List one alternative path and one test that could change the priority. Present the recommendation for the service owner to review.
Pair the matrix with a cost estimate
Use the original NARM worksheet and scenario table to document the rating. If the owner needs to compare funding options, move from the rating to a FAIR-AI estimate with separately sourced frequencies and losses.