Artificial Intelligence / Unit 9 AI 0514 short lesson, about 20 seconds
Statistical Residue
Captions available
The idea
A language model's training text is not stored inside it — what remains is statistical residue distilled into knob settings, not an archive.
In practice
The model can answer questions whose exact answer appears in no document, assembled from a thousand regularities — a feat no archive performs.
Where people slip
The fact cuts back — plainly-answered training-text questions can be missed; storage was never the mechanism.
Your place on the trail
Every lesson rests on earlier ones and opens later ones. Tap any to jump.
Something wrong in this lesson? Flag it · Sources for Artificial Intelligence