icefall icon indicating copy to clipboard operation
icefall copied to clipboard

Zipformer-DictinctK: Differentiating Repeated Characters

Open yfyeung opened this issue 2 years ago • 1 comments

Keeping a separate vector as an nn.Parameter in the model, and adding it times k/(1+k) to the embedding before the ReLU during training and decoding.

It only supports greedy_search and greedy_search_batch.

yfyeung avatar Nov 27 '23 15:11 yfyeung

Will this model change help with the kind of problem raised in issue https://github.com/k2-fsa/icefall/issues/1356 ? Thanks.

rouseabout avatar Nov 29 '23 02:11 rouseabout