seamless_communication icon indicating copy to clipboard operation
seamless_communication copied to clipboard

Finetuning on-device model

Open bil-ash opened this issue 1 year ago • 4 comments

Can the finetuning script provided at https://github.com/facebookresearch/seamless_communication/tree/main/scripts/m4t/finetune be used for the on-device(UnitY-Small) model (Hindi-to-English)? Also, can the script be used for adding a language to the on-device model (Bengali-to-English) which is currently not present?

bil-ash avatar Oct 05 '23 00:10 bil-ash

@cndn If yes, can the scripts be used as it is or minor changes are required?

bil-ash avatar Oct 08 '23 03:10 bil-ash

I also have a similar problem. I want to support voice recognition for Chinese, Japanese, English, and Korean on Android, and output the recognized content as Chinese text.

mabeijianxi avatar Oct 08 '23 13:10 mabeijianxi

@mabeijianxi did you find a solution?

Nivek92 avatar Dec 04 '23 17:12 Nivek92

Can the finetuning script provided at https://github.com/facebookresearch/seamless_communication/tree/main/scripts/m4t/finetune be used for the on-device(UnitY-Small) model (Hindi-to-English)? Also, can the script be used for adding a language to the on-device model (Bengali-to-English) which is currently not present?

Hi did you find any solution?

afzalzbr avatar Mar 27 '24 02:03 afzalzbr