Attention Mechanism
A neural network component that assigns varying weights to different parts of input data, enabling the model to focus on the most relevant information while providing some interpretability.
In plain language
The part of an AI that decides what to focus on. When translating a sentence, the attention mechanism might prioritise verbs first, then subjects; similar to how your eyes focus when reading.
Why this matters
Attention mechanisms improve model interpretability by making it clearer what information the AI is using to make decisions. This can help organisations demonstrate transparency and identify potential sources of bias or error.
Relevance
ImplementationInterpretable model architectures like those with attention mechanisms can support governance requirements for transparency and help technical teams diagnose and remediate model failures.
Related terms
Putting attention mechanism into practice in your organisation?
Ready to transform your AI strategy?
Partner with Australia's AI strategy and governance specialists. From adoption roadmaps to ISO 42001 audit readiness.