Failure Mode Analysis

A systematic approach to identifying, categorising and mitigating the ways in which an AI system can fail, malfunction or produce undesirable outputs.

Cataloging all the ways an AI can go wrong and planning for each one. For a medical AI: what if the image is blurry? What if the patient has a rare condition? What if the data is corrupted?

Failure mode analysis is a proactive governance tool that helps organisations anticipate and prepare for AI failures. Your governance framework should require failure mode analysis for all high-risk AI systems before deployment.