Transformer
A neural network architecture based on self-attention mechanisms that processes input sequences in parallel, serving as the foundation for modern large language models.
In plain language
The engine behind modern language AI. It is a specific AI design that is really good at understanding context and relationships in text. Almost all large language models are built on transformers.
Why this matters
Transformers are the architectural foundation underlying GPT, Claude and similar large language models that organisations increasingly depend on. Understanding this architecture helps your team evaluate AI risks, limitations and suitability for specific applications.
Relevance
StrategyProvides foundational technical knowledge to assess the capabilities and limitations of large language models, supporting informed strategic decisions about AI adoption and risk management.
Related terms
Putting transformer into practice in your organisation?
Ready to transform your AI strategy?
Partner with Australia's AI strategy and governance specialists. From adoption roadmaps to ISO 42001 audit readiness.