Skip to main content
SWStudyWalks Search

Artificial Intelligence / Unit 10   AI 0605 short lesson, about 20 seconds

Written vs. Meant

Captions available

The idea

An optimizer optimizes what is written, not what is meant — and as optimizers grow capable, the written-versus-meant gap stops producing wrong answers and starts producing wrong worlds.

In practice

A mistranslated constraint eliminated the truth efficiently; the calculus pursued handed utilities without question — the alignment problem is those lessons at scale.

Where people slip

Targets and intentions part company under optimization pressure — the proxy lesson, promoted.

Your place on the trail

Every lesson rests on earlier ones and opens later ones. Tap any to jump.

Something wrong in this lesson? Flag it  ·  Sources for Artificial Intelligence