Artificial Intelligence / Unit 9 AI 0512 short lesson, about 20 seconds
The Transformer
Captions available
The idea
A transformer stacks attention layers with ordinary weighted-sum-and-bend layers, mixes in position information so order matters, and trains end-to-end by descent with backward blame.
In practice
Attention reads all positions at once — a shape fitting parallel hardware, and why the 2017 design won the scale era.
Where people slip
Trainability at scale won as much as capability — three dials, and a machine built to spin them.
Your place on the trail
Every lesson rests on earlier ones and opens later ones. Tap any to jump.
Something wrong in this lesson? Flag it · Sources for Artificial Intelligence