Skip to main content

The Counting Wall

This video presents the same text shown beside it, spoken and on screen. It adds nothing the text does not say.

State

Counting-based language models die on sparsity — with a realistic vocabulary, almost every legal word sequence has never been written, so its count is zero.

Show

A 50,000-word vocabulary makes the bigram table two and a half billion cells; three-word contexts push past a hundred trillion.

Watch for

No pile of text on Earth fills those tables — "unseen" and "impossible" collapse into the same zero.