Artificial Intelligence / Unit 9 AI 0510 short lesson, about 20 seconds
One Row per Word
Captions available
The idea
A fixed embedding gives each word one row forever — "bank" occupies a single position whether the sentence means rivers or loans.
In practice
"She fished from the bank" and "she robbed the bank" hand the model identical rows for their pivotal word.
Where people slip
Fixing the flaw requires context to bend the rows at reading time — the transformer's entrance.
Your place on the trail
Every lesson rests on earlier ones and opens later ones. Tap any to jump.
Builds on
Unlocks
Something wrong in this lesson? Flag it · Sources for Artificial Intelligence