Understanding Transformers Part 17: Generating the Output Word

A Transformer decoder turns its final hidden states into vocabulary scores with a dense layer.

Softmax selects the most likely output word from the vocabulary.

The predicted word is fed back into the decoder to generate the next token.

This process repeats until an end-of-sequence token is produced, completing the sentence.