Home / Figures / Chapter 2

Figure 2.3: Sampling as a weighted lottery run once per token

The text so far feeds the model, which prints odds for the next token (mat 0.42, floor 0.18, sofa 0.13, rug 0.09); the decoder draws one ticket, this time floor, and it fills the open slot in the sentence.
Figure 2.3 Sampling as a weighted lottery run once per token. The model prints the odds and the decoder draws a ticket; the favorite usually wins, but not always, and each draw takes its place in the sentence so far.