xlnet icon indicating copy to clipboard operation
xlnet copied to clipboard

Published 20 hours ago • verified publisher icon zihangdai

num_predict flag

Open Mahasweta-usc opened this issue 5 years ago • 0 comments

What is the significance of num_predict in terms of number of tokens to be predicted? My data mostly comprises small snippets of social media text, and a few larger comprehensions. Should I set num_predict less than 85 in pre-training?

Mahasweta-usc avatar Sep 13 '19 05:09 Mahasweta-usc