Jobescape
AI glossary

Transformer

A transformer is a type of neural network design that powers modern language models - it is especially good at processing sequences such as text and understanding context.

Start Free QuizBrowse courses

In this guide

  1. 1What Transformer means
  2. 2Why Transformer matters

What Transformer means

The transformer is a model design introduced in 2017 that changed AI dramatically. Its key strength is an attention mechanism, which lets the model weigh how important every word is to every other word when working out meaning.

For example, in the sentence "she put the book on the table because it was sturdy," a transformer can work out that "it" refers to the table, not the book - by paying attention to how the words relate across the whole sentence.

Why Transformer matters

The transformer is the breakthrough that made today's AI tools possible - the "T" in GPT stands for transformer. Knowing the term helps you understand where modern AI came from.

Transformers power nearly every modern language model
The design is the reason today's AI handles context so well
The term shows up often in any discussion of how AI works
Understanding it adds helpful background, no math required

Frequently asked questions

No. Transformers are a technical detail of how AI is built. A simple awareness of the term is enough - you can build powerful no-code AI tools without studying it.

More AI terms

InferenceThe stage where a trained AI model is actually used to produce an answer or result from new input.GPTA family of large language models - GPT stands for Generative Pre-trained Transformer.Supervised LearningA machine learning method where a model learns from examples that are already labeled with the correct answer.Unsupervised LearningA machine learning method where a model finds patterns in data that has no labels or correct answers.Reinforcement LearningA machine learning method where a model learns by trial and error, guided by rewards for good outcomes.APIA defined way for two software systems to talk to each other and share data or features.

Ready to build the AI skills your future depends on?

Take the free 5-minute quiz and get a personalized learning plan built around your goals, schedule, and experience.

Start Free QuizBrowse courses