PureT icon indicating copy to clipboard operation
PureT copied to clipboard

question about "-1" and "0"

Open zml110120 opened this issue 2 years ago • 1 comments

Dear author, I have a question.

What is the difference between "-1" in "TARGET_SENT" and "0" in "INPUT_SENT"? Just like the first image and second image? "-1" means padding and "0" means the end of sentence?

image image

zml110120 avatar Aug 03 '22 12:08 zml110120

Dear author, I have a question.

What is the difference between "-1" in "TARGET_SENT" and "0" in "INPUT_SENT"? Just like the first image and second image? "-1" means padding and "0" means the end of sentence?

image image

Right! And: "-1" in "TARGET_SENT" is convenient for computing loss.

  • XE loss image

  • label smoothing image

232525 avatar Aug 03 '22 13:08 232525