av_hubert icon indicating copy to clipboard operation
av_hubert copied to clipboard

Published 20 hours ago • verified publisher icon facebookresearch

Error loading AVSR model

Open llamasrock opened this issue 1 year ago • 3 comments

I'm working with the Colab demo and I wasn't satisfied with the performance of the model provided there. I tried to switch to one of the AVSR models instead but I'm getting an error which I don't understand. I hope to get some help here - thank you in advance!

I chose the "Noise-Augmented AV-HuBERT Base" model which was downloaded without any issue:

image

I haven't changed anything in the "Inference with the model" section and this is where I get an error:

image image

llamasrock avatar Apr 27 '23 02:04 llamasrock

hii sir, i am also facing the same issue, please let me know if you find a solution

friendlyhacker-py avatar May 21 '23 09:05 friendlyhacker-py

hii sir, i am also facing the same issue, please let me know if you find a solution

I'm sorry, I didn't pursue this at the end and just used the base model in my project.

llamasrock avatar Jun 15 '23 06:06 llamasrock

Hi, Change this line: https://github.com/facebookresearch/av_hubert/blob/258fb50e155134eec2c4b49c2ae8de267075fd18/avhubert/hubert_dataset.py#L191 To this:

        self.noise_wav, self.noise_prob, self.noise_snr, self.noise_num = [], noise_prob, noise_snr, noise_num

```

orena1 avatar Nov 08 '23 04:11 orena1