Council10

The Cost of Not Knowing

Why uncertainty about automated work is a management problem in its own right


A failed action leaves a problem to solve. An action whose outcome cannot be established leaves a second problem: deciding what is safe to do next.

Consider a payment submitted through an automated system. The request times out before a confirmation arrives. A well-designed service may make resubmission safe or offer an authoritative way to check status. Where it offers neither, the timeout leaves the outcome open. The payment may have failed. It may also have gone through, with only the confirmation lost. Repeating it could pay twice. Abandoning it could leave an obligation unmet. Waiting defers the decision without necessarily improving the information it will be made on.

Nothing about the payment itself has changed. The exposure, and the choices available, have. Until the uncertainty is resolved, even an ordinary next step carries a risk that would otherwise be avoidable.

Accuracy and productivity do not, on their own, establish what an organization can safely rely on. A system can produce useful work while leaving its operators unable to say what happened, whether it was authorized, or what can now be trusted. The resulting uncertainty can consume attention, delay decisions and make later work harder to trust.

The burden passes to the next decision

Work rarely ends with the action itself. A payment changes an account. A deployment changes the environment other work runs in. A message to a customer creates an expectation. A finished analysis becomes the input to someone else's decision.

When the outcome of one action is uncertain, the next person or system has to resolve that uncertainty or carry it forward. Carrying it forward can be reasonable when the consequences are small and the assumption is stated. It becomes dangerous when an assumption is recorded as fact and later participants have no reason to question it.

Consider another case: an agent reports that a change has been deployed. A second agent begins validation, and a third drafts a customer update. If the first report cannot be tied to the intended environment and version, the later tasks may be building on the wrong starting point. More work has happened. The original uncertainty is still there.

The cost can therefore exceed the time needed to repeat a single task. It can include tracing which later decisions depended on the first one, working out which conclusions still hold, and restoring confidence in the record. Uncertainty acquires its consequences through the work that relies on it. The management burden is less about recovering one missing fact than about deciding which dependent judgments can still stand.

A record must support a conclusion

Having records does not settle the matter. A record can show that a request was submitted without showing that the action took effect. A passing check can establish the state of one environment at one moment without establishing the condition a later decision depends on.

Management needs evidence that answers a specific question. What action occurred? What did it affect? Under whose authority? What result was observed? How far does that observation justify reliance?

These questions are related, but an answer to one cannot automatically stand in for the others. Uncertainty about an effect, about authorization, and about fitness for later use may each call for different evidence and a different decision-maker. An action can succeed without being authorized. An authorized action can fail. A result can be useful and still fall short of supporting the conclusion someone wants to draw from it.

A design can require evidence without yet producing it. An implemented control can exist without proving what happened in a particular transaction. A verified result establishes only what its evidence supports.

The distinction matters because a record that looks complete is often more persuasive than one that is openly incomplete. The difficulty then lies in recognizing that the evidence establishes less than the organization believes. More documentation cannot close that gap unless it answers the question on which reliance depends.

Restriction alone leaves questions unanswered

Restrictions define what may be attempted and by whom. They are necessary wherever an action could create consequences the organization is unwilling to accept. But permission to act and knowledge of what happened are separate responsibilities.

A narrowly permitted action can still have an uncertain outcome. An unauthorized action can still produce an apparently correct result. Preventing one kind of failure does not rule out the other.

Too little control can invite harm and uncertainty. Too much can stop the work altogether. The practical requirement is to match each role's access to its authorized responsibilities, while keeping enough evidence for consequential actions to be understood and reviewed. An assignment does not by itself grant access or waive a protected boundary.

That evidence has to remain useful when work is interrupted, handed over or questioned later. Otherwise the organization depends on the memory of whoever acted, at exactly the moment that memory may be unavailable or unreliable.

Unknown is a legitimate operating state

An organization has to be able to say that an outcome is unknown without the admission being read as a lack of confidence or competence. The uncertainty should attach to a specific claim. It should not erase facts already established.

Pressure for a definite answer can force premature closure. Work gets called complete because a request was sent, because no error appeared, or because someone produced a plausible account. Each may be relevant. None necessarily settles the question.

Leaving an outcome unresolved should serve a purpose. Someone has to own the next decision, understand what remains uncertain, and judge whether more evidence is worth obtaining. Otherwise uncertainty becomes an open-ended holding area where responsibility disappears.

Unknown is not a universal stop condition. Different situations justify different responses, depending on the consequence, reversibility, detectability and urgency of the action, and on the risk that the uncertainty spreads into later work. A reversible, low-consequence action may allow a cautious next step under a stated assumption. A payment, a change to access or a commitment to a customer may need stronger confirmation. The standard of evidence should reflect both the cost of being wrong and the cost of finding out. Investigation should stop when its likely benefit to the decision no longer justifies its cost and delay.

This is a judgment made under uncertainty, not a calculation that can always be done precisely. A decision-maker may seek more evidence, proceed within a bounded exposure, or hold the affected action. Whichever they choose, the assumption and the reason for it should stay visible.

The aim is not certainty about everything. It is an explicit basis for deciding where reliance is justified and where it is not.

The organization carries what the agent cannot settle

An agent's account of its work is one input to that decision. It cannot by itself establish every fact about an external system, or confer authority the organization has not granted.

Responsibility therefore reaches beyond whoever performed the task. Someone has to define the conditions under which the result may be used. Someone has to keep the relevant evidence. Someone has to decide what happens when the evidence and the account disagree. These responsibilities can be assigned to roles and processes. They do not require a new human approval for every action.

Together they make the basis for a decision available to someone other than the original participant. They also allow a confident account to be challenged without throwing away the work that was genuinely done, so the useful result and the unsupported conclusion can be separated.

An organization that cannot draw these distinctions may rely on poorly supported claims or spend avoidable effort reconstructing the evidence. Sampling, risk-tiered assurance and informed acceptance of residual uncertainty are more proportionate responses, provided their limits are understood.

Confidence that can be carried forward

Governance earns its place when it improves the decisions an organization can responsibly make. A larger rulebook or a more detailed report has value only to the extent it serves that purpose. The test is whether the evidence changes a consequential decision, not whether the record looks exhaustive.

For automated work, that means knowing when an outcome is established, recognizing when it is not, and preserving the difference as work passes between participants. It means making uncertainty visible before someone unknowingly builds on it.

The cost of not knowing can be paid in delayed action, duplicated effort, unnecessary verification and misplaced reliance. Some uncertainty is unavoidable. Even where organizations cannot eliminate it, they can decide how it is surfaced and who owns it.

A capable organization gives its people and agents a basis for the next decision: what happened, what can be trusted, and what still needs to be resolved.