The Counting Wall
This video presents the same text shown beside it, spoken and on screen. It adds nothing the text does not say.
State
Counting-based language models die on sparsity — with a realistic vocabulary, almost every legal word sequence has never been written, so its count is zero.
Show
A 50,000-word vocabulary makes the bigram table two and a half billion cells; three-word contexts push past a hundred trillion.
Watch for
No pile of text on Earth fills those tables — "unseen" and "impossible" collapse into the same zero.