seamless_communication
seamless_communication copied to clipboard
facebookresearch
Foundational Models for State-of-the-Art Speech and Text Translation
can let me know minimum RAM requirements about each model (M4T_Large, M4T_Medium)?
How could I make this work in a meeting setting, for example? I need a solutions that could preferably distinguish each person who's talking, It would even learn the voice...
on a colab GPU instance, I setup m4t runtime env and try a s2tt task. It produce bad quality transcription as follows compared whisper. I wonder if I have been...
I try to test asr task in cli, but failed, do I miss anything? $m4t_predict --model seamlessM4T_medium 16k.wav asr eng 2023-08-23 16:17:41,203 INFO -- m4t_scripts.predict.predict: Running inference on the GPU....
I tried a 1 minute audio and it worked just fine but when I tried 7 minutes audio. it throws this error `The input sequence length must be less than...
Hi there, I see that Albanian is not on the list of supported languages. What can be done by anyone from the Albanian speaking community to have our language supported?
Hi, the original paper mentions SeamlessWM, but I couldn't find it in the source code and can't get if it is now applied after the main Unity2 generation pipeline or...
Anyone can help me with how to implement seamless expressive in real-time with no latency ? Also, Suggest me some code references to implement. I am also interested in learning...
This fixes some issues with M4T finetuning CLI and enables freezing parts of a model before training **Example:** ``` m4t_finetune \ --train_dataset gigaspeech/xs/xs_train_manifest.json \ --eval_dataset gigaspeech/xs/xs_validation_manifest.json \ --batch_size 10 \...
Implements a new training script for training a classification head. The new nn.module in model.py is separate from other components of M4T and takes speech encoder output and maps it...
Metadata
Owner
Metadata
Foundational Models for State-of-the-Art Speech and Text Translation