OpenSeq2Seq icon indicating copy to clipboard operation
OpenSeq2Seq copied to clipboard

Question: how to integrate RNNLM into speech2text ctc with lm decoder?

Open d2sys opened this issue 6 years ago • 4 comments

d2sys avatar Jan 08 '19 08:01 d2sys

I think one of the ways is to extend the method _compute_loss inside MultiTaskCTCEntropyLoss class with RNNLM loss

d2sys avatar Jan 08 '19 13:01 d2sys

This is a great idea.

GabrielLin avatar Jan 10 '19 03:01 GabrielLin

I think one of the ways is to extend the method _compute_loss inside MultiTaskCTCEntropyLoss class with RNNLM loss

Hello, have you integrated RNNLM into speech2text ctc ?After integrated, it will improve the output of the acoustic model or only improve the word-level output text? And ,is the integrating process different from the process of external lm rescore? If you have done this ,can you show the code or please help solve my doubts in detail? Thank you

xw1324832579 avatar Jun 18 '19 08:06 xw1324832579

Any updates regarding this topic? Has anyone implemented this ?

raikarsagar avatar Dec 26 '19 06:12 raikarsagar