FunASR icon indicating copy to clipboard operation
FunASR copied to clipboard

automodel推理

Open wwfcnu opened this issue 1 year ago • 3 comments

from funasr import AutoModel
# paraformer-zh is a multi-functional asr model
# use vad, punc, spk or not as you need
model = AutoModel(model="paraformer-zh",  vad_model="fsmn-vad",  punc_model="ct-punc", 
                  # spk_model="cam++", 
                  )
res = model.generate(input=f"{model.model_path}/example/asr_example.wav", 
                     batch_size_s=300, 
                     hotword='魔搭')
print(res)

model的vad和punc是默认开启的吧,如果我不要vad,punc_model,怎么设置参数,写成下面这样吗 model =AutoModel(model="paraformer-zh", vad_model="", punc_model="")

wwfcnu avatar Jul 03 '24 05:07 wwfcnu

另外就是我想改动batch_size=64,修改哪个参数 image batch_size_s=300和batch_size是啥关系

wwfcnu avatar Jul 03 '24 06:07 wwfcnu

我推理的时候,显存不断增加,然后过一段时间就oom了,我设置的batch_size很小,数据也是10s左右的。

wwfcnu avatar Jul 03 '24 07:07 wwfcnu

我推理的时候,显存不断增加,然后过一段时间就oom了,我设置的batch_size很小,数据也是10s左右的。

请问解决了吗

secslim avatar Aug 13 '24 03:08 secslim