seamless_communication
seamless_communication copied to clipboard
NotImplementedError: T2U finetuning implemented only for UnitYT2UModel why??!!
why??!!
%cd /content/my_seamless_communication/src
!torchrun
--rdzv-backend=c10d
--rdzv-endpoint=localhost:0
--nnodes=1
--nproc-per-node=1
/content/my_seamless_communication/src/finetune.py
--mode SPEECH_TO_SPEECH
--train_dataset /content/my_m4t_dataset/train_manifest.json
--eval_dataset /content/my_m4t_dataset/validation_manifest.json
--learning_rate 1e-6
--warmup_steps 100
--max_epochs 5
--patience 5
--batch_size 3
--save_model_to /content/my_m4t_dataset/checkpoint1.pth
--model_name seamlessM4T_v2_large