The Next-Word Task
This video presents the same text shown beside it, spoken and on screen. It adds nothing the text does not say.
State
A language model assigns probabilities to what comes next in a running text — and modern language machines are built by making that one prediction extremely good.
Show
"The plumber said the leak was under the ___" — scoring that blank well demands grammar, world knowledge, and conversation tracking at once.
Watch for
Prediction's ceiling is enormous — pressing on it recruits whatever regularities help.