FunASR icon indicating copy to clipboard operation
FunASR copied to clipboard

自己训练的模型,inference结果为空

Open h310558606 opened this issue 1 year ago • 5 comments

基于FunASR/egs进行模型训练,得到一个适用于小语种ASR的paraformer模型,然后将此模型训练得到的的模型文件和config文件替换掉damo/speech_paraformer_asr_nat-zh-cn-16k-aishell1-vocab4234-pytorch 下的模型文件与config文件,接下来使用如下代码进行推理:

from modelscope.pipelines import pipeline from modelscope.utils.constant import Tasks

inference_pipeline = pipeline( task=Tasks.auto_speech_recognition, model='models_from_modelscope/damo1/speech_paraformer_asr_nat-zh-cn-16k-aishell1-vocab4234-pytorch', ) rec_result = inference_pipeline(audio_in='https://isv-data.oss-cn-hangzhou.aliyuncs.com/ics/MaaS/ASR/test_audio/asr_example_zh.wav') print(rec_result)

返回结果为空值!!!

image 05(1) 03

h310558606 avatar Nov 22 '23 06:11 h310558606

Maybe the diff is am.mvn, please check it.

LauraGPT avatar Nov 23 '23 15:11 LauraGPT

Maybe the diff is am.mvn, please check it.

I replaced the am.mvn file used for training, and the result was still the same. There was no inference output. When I printed the intermediate results, I found that the output was all unk characters.

h310558606 avatar Nov 24 '23 03:11 h310558606

Maybe the diff is am.mvn, please check it.

I replaced the am.mvn file used for training, and the result was still the same. There was no inference output. When I printed the intermediate results, I found that the output was all unk characters.

Does you ever test the inference in the stage5:https://github.com/alibaba-damo-academy/FunASR/blob/main/egs/aishell/paraformer/run.sh#L157

LauraGPT avatar Nov 24 '23 03:11 LauraGPT

Maybe the diff is am.mvn, please check it.

I replaced the am.mvn file used for training, and the result was still the same. There was no inference output. When I printed the intermediate results, I found that the output was all unk characters.

Does you ever test the inference in the stage5:https://github.com/alibaba-damo-academy/FunASR/blob/main/egs/aishell/paraformer/run.sh#L157

Yes, I run the stage 5, but get nothing.

The train log: train The test log: test image

h310558606 avatar Nov 24 '23 05:11 h310558606

Maybe the diff is am.mvn, please check it.

I replaced the am.mvn file used for training, and the result was still the same. There was no inference output. When I printed the intermediate results, I found that the output was all unk characters.

Does you ever test the inference in the stage5:https://github.com/alibaba-damo-academy/FunASR/blob/main/egs/aishell/paraformer/run.sh#L157

Yes, I run the stage 5, but get nothing.

The train log: train The test log: test image

Please check the inference log, and see what happens

LauraGPT avatar Nov 24 '23 14:11 LauraGPT