Myth of verification
noun phrase
The comforting idea that a human clicking ‘Approve’ at the end has supplied the judgement the process needed at the beginning. Usually they’ve only supplied the click.
The myth of verification is the comforting belief that placing a human at the end of an AI process guarantees human judgement. It does not. A person clicking Approve may be tired, rushed or unable to recognise what is wrong. The judgement that mattered should have started earlier: in the question, the assumptions, the missing context, the decision about what deserves suspicion. A human in the loop is useful only when the human is actually thinking. Otherwise the loop is theatre with a button.
See also Cultural debt Botsitting Hallucination