Artificial Intelligence / Unit 10 AI 0562 worked example, 60 to 90 seconds
The Bar-Exam Claim, Expanded
The idea
Expanding "our model passed the bar exam" into its three clauses turns a headline into a list of answerable questions.
In practice
The task clause: which exam form, scored by whose rubric, at what passing line? Passing a multiple-choice section rewards answer-picking — a different skill from practicing law, so the measured task must be named before the verb "passed" means anything. The distribution clause: which questions circulated publicly before training? A model that read the exam's text holds its residue, and a lawyer's Tuesday does not resemble exam conditions — the score transfers exactly as far as the resemblance runs. The conditions clause: how many attempts, what tool access, what time limits, what human formatting help? Each vanished condition was load-bearing. Three clauses, maybe ten questions — and the claim either survives them with its meaning sharpened, or dissolves into "a system scored well on something, somehow, once."
Where people slip
The expansion is symmetric — it deflates the boast and it deflates the sneer, because both skip the same three clauses.
Your place on the trail
Every lesson rests on earlier ones and opens later ones. Tap any to jump.
Builds on
Unlocks
- Nothing yet depends on this.
Something wrong in this lesson? Flag it · Sources for Artificial Intelligence