Mask-Align icon indicating copy to clipboard operation
Mask-Align copied to clipboard

Operation about bpe

Open chrisgao7 opened this issue 2 years ago • 1 comments

Did you apply bpe in your train data? What do you mean by "We used a joint source and target Byte Pair Encoding (BPE) (Sennrich et al., 2016) with 40k merge operations." in your artical sector 3.1?

chrisgao7 avatar May 15 '22 13:05 chrisgao7

I tried bpe training and the result is not as satisfactory as original corpus. Have you tried this before and do you have some comments about this?

chrisgao7 avatar May 15 '22 13:05 chrisgao7