AI Redlining
The practice, often unintentional, where AI systems systematically deny services or opportunities to people in certain geographic areas or demographic groups, mirroring historical discriminatory practices.
In plain language
When AI unintentionally creates no-go zones. A delivery app that avoids certain neighbourhoods or a lending AI that systematically denies loans in specific areas echoes old discriminatory practices.
Why this matters
AI redlining represents a serious compliance and reputational risk. Your AI governance processes should include geographic and demographic impact analysis to ensure AI systems do not systematically disadvantage particular communities.
Relevance
ImplementationRedlining detection and prevention are implementation practices that protect against discriminatory outcomes and regulatory violation.
Related terms
Putting ai redlining into practice in your organisation?
Ready to transform your AI strategy?
Partner with Australia's AI strategy and governance specialists. From adoption roadmaps to ISO 42001 audit readiness.