av_hubert icon indicating copy to clipboard operation
av_hubert copied to clipboard

Published 20 hours ago • verified publisher icon facebookresearch

How to train a LM used for decoding

Open li563042811 opened this issue 2 years ago • 2 comments

Hi, Thank you for your work. I saw lm_model and lm_weight in the config file. But how to train this LM using our own text data?

li563042811 avatar Dec 03 '22 15:12 li563042811

Hi,

We didn't use LM during decoding. If you want to use a language model, you can follow the fairseq LM instructions for training.

chevalierNoir avatar Dec 04 '22 23:12 chevalierNoir

Hi,

We didn't use LM during decoding. If you want to use a language model, you can follow the fairseq LM instructions for training.

Thank you for your reply. We have trained an LM following the fairseq LM instructions and it worked. Although the decoding results with LM are not as better as we expected.

li563042811 avatar Dec 05 '22 08:12 li563042811