VoiceCraft icon indicating copy to clipboard operation
VoiceCraft copied to clipboard

non-speech sounds like suno bark ?

Open Revln9 opened this issue 1 year ago • 5 comments

is it possible to generate interjections with this model like mhmm or aha ?

Revln9 avatar Apr 03 '24 18:04 Revln9

Thanks! There are two possible way to have interjections:

  1. If the prompt has sounds like that, it's possible that the model will add that to the generation spontaneously
  2. if you wrote these in the target transcript, the model will just follow

jasonppy avatar Apr 04 '24 15:04 jasonppy

Thanks! There are two possible way to have interjections:

  1. If the prompt has sounds like that, it's possible that the model will add that to the generation spontaneously
  2. if you wrote these in the target transcript, the model will just follow

So theoretically, VoiceCraft can be used to generate singing melody (vocal only) ?

yoesak avatar Apr 20 '24 09:04 yoesak

Thanks! There are two possible way to have interjections:

  1. If the prompt has sounds like that, it's possible that the model will add that to the generation spontaneously
  2. if you wrote these in the target transcript, the model will just follow

So theoretically, VoiceCraft can be used to generate singing melody (vocal only) ?

I think it's unlikely to generate singing voice out-of-the-box, just because the training data is speech data. You could finetune it on singing data

jasonppy avatar Apr 20 '24 16:04 jasonppy

Cool, I will try with singing data. Thanks

yoesak avatar Apr 21 '24 00:04 yoesak

Hi @yoesak! It is quite interesting to see VC for different application. Can you share your progress on generating songs using Voicecraft?

Magauiya avatar Aug 28 '24 14:08 Magauiya