pre-training perplexity

[gianfilippo]

Hi,

I am pre-training your model and would like to have the perplexity plot/values in your pre-training stage, if possible, to see how I am doing. If the pre-training perplexity history is unavailable, the final perplexity is also ok. I would expect that, given the same model, I should achieve comparable perplexity.

Thanks

[phmin]

May I know the final perplexity result? I would like to get an idea of the approximate value. Thank you.