Automation Bias
The tendency of humans to over-rely on automated systems and AI recommendations while ignoring contradictory information from other sources or their own judgment.
In plain language
The tendency to blindly trust what the computer recommends. When an AI suggests approving a loan or hiring a candidate, people often follow that suggestion without sufficiently questioning it, even when they have reasons to be sceptical.
Why this matters
Automation bias undermines the value of human oversight in AI governance. If your team treats AI outputs as gospel, your controls become window dressing. Effective governance requires designing processes and training that actively encourage critical evaluation of AI recommendations.
Relevance
GovernanceAutomation bias directly affects how well human oversight functions; it is a core governance risk that requires process design and staff training to mitigate.
Related terms
Putting automation bias into practice in your organisation?
Ready to transform your AI strategy?
Partner with Australia's AI strategy and governance specialists. From adoption roadmaps to ISO 42001 audit readiness.