Calculate test loss and perplexity for language model

Open NirantK opened this issue 7 years ago • 3 comments

Mar 06 '18 04:03 NirantK

@NirantK could you tell me how you calculated the perplexity for your model? is it e^ loss ?

Oct 04 '18 10:10 Shashi456

The training (and/or validation) loss and perplexity are calculated during model training as shown in the notebook. This is done by fastai implementation of metrics via hooks.

We can repeat the same on test data. This is yet to be done - as indicated by this issue.

Oct 04 '18 10:10 NirantK

You aren't printing perplexity anywhere, you've just mentioned it in a comment. So I had a doubt about the same. Thank you for your answer.

Oct 04 '18 10:10 Shashi456