char-rnn-tensorflow icon indicating copy to clipboard operation
char-rnn-tensorflow copied to clipboard

Tuning the temperature

Open aamelegy opened this issue 8 years ago • 1 comments

Is there a way to tune the temperature parameter ?

Temperature. An important parameter you may want to play with is -temperature, which takes a number in range (0, 1] (0 not included), default = 1. The temperature is dividing the predicted log probabilities before the Softmax, so lower temperature will cause the model to make more likely, but also more boring and conservative predictions. Higher temperatures cause the model to take more chances and increase diversity of results, but at a cost of more mistakes. https://github.com/karpathy/char-rnn

aamelegy avatar Apr 24 '16 10:04 aamelegy

I think it's a good feature to implement. Can you come up with a PR?

hunkim avatar Apr 28 '16 13:04 hunkim