NeuralDialog-LAED icon indicating copy to clipboard operation
NeuralDialog-LAED copied to clipboard

Order problem of <s> and </s>

Open LeiCaiwsu opened this issue 5 years ago • 2 comments

BOS and EOS have the same count in the vocabulary. The counter sort the utterances by frequency. Since BOS and EOS have the same count in the vocabulary, the order is random. Sometimes BOS is 4 in vocabulary. Sometimes EOS is 4 in vocabulary.

LeiCaiwsu avatar Jan 02 '19 16:01 LeiCaiwsu

That should cause a problem in a single run right?

snakeztc avatar Jun 21 '19 15:06 snakeztc

In single run, there is no problem. It will raise some problems when reloading the model to generate text.

LeiCaiwsu avatar Jun 21 '19 17:06 LeiCaiwsu