Temperature (in Generation)

A hyperparameter controlling randomness in generation. Low temperature (~0.1) makes sampling deterministic and greedy (always pick the highest probability). High temperature (~2.0) makes the model sample more randomly, producing more diverse outputs.