nebuly
nebuly copied to clipboard
[Chatllama] Should I add a <end_of_text> at the end of sentence?
When I train a actor model with bloom-560M. I realize that , the model generates the text repeated at the end. The model always generates enough words predefined by max_length but it;s not stop early. Should I add a <end_of_text> at the end of sentence when training?