TensorFlowASR icon indicating copy to clipboard operation
TensorFlowASR copied to clipboard

Contextual Biasing | Adding hints at runtime for Streaming transducers

Open tumusudheer opened this issue 4 years ago • 3 comments

Hi,

It is really great work. Thank you very much for the streaming transducers. Is it possible to add hints at runtime (In streaming transducers)(Section: 4) (Say I have some names which are not available at the time of training but at the inference time, I've some knowledge on what I'm looking for), How can I use a set/list of phrases as hints at inference (testing) time ?

Thank you

tumusudheer avatar Jan 11 '21 04:01 tumusudheer

The contextual biasing is not supported yet :smile: May be after I figure out how to add LM to decoder

nglehuy avatar Jan 11 '21 05:01 nglehuy

Thanks @usimarit

The streaming demonstration example uses conformer. Do you have a sample code for streaming audio using streaming transducers ?

Also, I want to train streaming transducers. Seems only conformer pre-trained models are available #61. It would be great if you can provide streaming transducers pre-trained model to finetune from ?

Thank you

tumusudheer avatar Jan 11 '21 07:01 tumusudheer

@tumusudheer No currently I haven't trained streaming transducer so I don't have sample code for streaming audio and pretrained model.

nglehuy avatar Jan 11 '21 17:01 nglehuy