Generative AI at Work / Unit 5 GAI 108 short lesson, about 20 seconds
Test on Your Own Cases
Captions available
The idea
NIST's framework says accuracy should be measured on realistic test sets that represent the conditions a system will actually be used in.
In practice
Twenty of last month's real requests, with known correct answers, used to try a tool before the team adopts it.
Where people slip
The vendor's demonstration shows what the tool can do, not what it does with your material.
Your place on the trail
Every lesson rests on earlier ones and opens later ones. Tap any to jump.
Something wrong in this lesson? Flag it · Sources for Generative AI at Work