seamless_communication icon indicating copy to clipboard operation
seamless_communication copied to clipboard

Low quality results compared to Huggingface spaces and Demo!

Open arash-aut opened this issue 2 years ago • 4 comments

Hello everyone, I tried to test the reported results on Google Colab, but when I compared the results with Huggingface space using the same inputs, it appeared that there is a wide gap between them! I also, turned "ngram-filtering" to True but it changed nothing! Here is the link to my experiment: link

I would be grateful if anyone can help me reach the performances of Huggingface spaces or Demo.

Thank you!

arash-aut avatar Sep 02 '23 05:09 arash-aut

can you make your notebook public and accessible?

RohitMidha23 avatar Sep 04 '23 11:09 RohitMidha23

Could you compare your implementation with HF demo around https://huggingface.co/spaces/facebook/seamless_m4t/blob/main/app.py#L78? Note that resampling might be needed.

cndn avatar Sep 06 '23 21:09 cndn

Hi Ning, Thank you for your responce! I think the problem is solved. I'm getting the same result as Huggingface space and Demo NOW! @cndn

arash-aut avatar Sep 11 '23 05:09 arash-aut

Could you compare your implementation with HF demo around https://huggingface.co/spaces/facebook/seamless_m4t/blob/main/app.py#L78? Note that resampling might be needed.

Screenshot 2023-09-13 at 12 42 21 AM I am getting same low quality results compared to huggingface demo. When I resampled it to 16KHz same as mentioned in repo and also in huggingface app.py. I am getting error that it needed sample rate of 44100 instead of 16000

pp268 avatar Sep 12 '23 19:09 pp268