What AI governance actually means for a board
The real test of AI governance is whether you can reconstruct what a system did and why, months later, for someone with the power to penalise you.
AI governance is the ability to reconstruct, explain and defend any decision an AI system has taken on your behalf, months after the event, to someone with the power to penalise you for it. Policies, committees and principles matter only insofar as they produce that ability. A board that can evidence what its systems did has governance; a board that can only describe its intentions has paperwork.
Most boards find out which of the two they hold at a specific moment: a customer disputes an outcome, an auditor samples a transaction, or a regulator sends a written question, and someone asks the operations team to show exactly what the system saw, what it decided and who approved the result.
What does it cost when nobody can explain an AI decision?
The direct costs land fast. An unanswerable question from an auditor becomes a finding. An unanswerable question from a regulator becomes a formal information request with a deadline attached. A customer dispute that a single log entry would have settled turns into a negotiation you conduct from weakness, because the other side can see you are unable to show your workings.
The indirect cost is usually larger. Once a board learns it cannot explain one system, it stops trusting all of them, and the standard response is a freeze on anything labelled AI while a review runs. Teams that were saving real hours go back to manual work. The absence of records ends up costing more than keeping them ever would have.
What evidence should a board ask to see?
Ask for a live reconstruction of one recent automated decision, chosen at random. The team should produce four things without ceremony: the input the system received, the version of the prompts or rules in force at the time, the output it generated, and the named person who approved anything consequential. If assembling that takes a day of archaeology, the capability does not yet exist, whatever the policy document says.
One of our builds began at exactly this point. A UK financial-services firm had staff already experimenting with AI and a board unwilling to approve any of it blind. Six weeks of work mapped and risk-scored 18 AI use cases and designed every approved live workflow with an audit trail, which gave the board a basis for saying yes that it could later defend.
When should the records be built?
During the build itself, before anything goes live. The early months of a new system are when errors are most likely and scrutiny is most valuable, and a retrofitted audit trail leaves precisely that period dark. Reconstructing history for a system that never logged it is close to impossible.
We therefore treat the log, the approval gate and the reconstruction test as build requirements, on the same footing as the feature list. A system that cannot produce its own history is unfinished, however impressive the demo.
Why we measure every AI build against one number
Most AI programmes stall on the choice of first project. Scoring every candidate on monthly payback settles the choice with arithmetic instead of opinion.
Own your AI, do not rent it
If you cannot inspect the code, the prompts and the data, you do not really control the system running your business.