Generative AI You Can SeeLesson 5 / 14About 8 min
Which tokens can still be sampled?
Top-P：How candidates are retained
Task 1 / 7 · Bridge
On a bitterly cold winter day,
the weather is very?The same open position
Context → base probabilities → Temporarily exclude some candidates?
Current baseline probabilities
Base probability (fixed)
good
17%
cold
61%
hot
8%
bad
9%
.
5%
Base total 100%
Same sentence and original probabilities. Temperature stays at 1; only the set of eligible tokens changes.