Understanding Text Generation Parameters in Transformers
This post is divided into seven parts; they are: • Core Text Generation Parameters • Experimenting with Temperature • Top-K and Top-P Sampling • Controlling Repetition • Greedy Decoding and Sampling • Parameters for Specific Applications • Beam Search and Multiple Sequences Generation Let's pick the GPT-2 model as an example.
This post is divided into seven parts; they are: • Core Text Generation Parameters • Experimenting with Temperature • Top-K and Top-P Sampling • Controlling Repetition • Greedy Decoding and Sampling • Parameters for Specific Applications • Beam Search and Multiple Sequences Generation Let's pick the GPT-2 model as an example.
