xlnet icon indicating copy to clipboard operation
xlnet copied to clipboard

Is it possible feed xlnet to seq2seq encoder/decoder NMT (for low resource language)?

Open JohnasSolomon opened this issue 5 years ago • 0 comments

I'm working on NMT model which the input and the target sentences are from the same language (but the grammar differs). I'm planning to pre-train and use xlnet since I'm working on small dataset and low/under resource language. so is it possible to feed xlnet to the seq2Seq encoder/decoder?

JohnasSolomon avatar Feb 22 '20 20:02 JohnasSolomon