usdb_syncer icon indicating copy to clipboard operation
usdb_syncer copied to clipboard

Option to automatically create a karaoke/instrumental version by stripping vocals from audio

Open bohning opened this issue 2 years ago • 4 comments
trafficstars

Spleeter or demucsV4 do a pretty good job in separating vocals and instrumental part and could be used for that.

Pro:

  • real karaoke without the original singer’s voice

Con:

  • will take long without GPU/CUDA
  • will bloat the executable

bohning avatar Sep 19 '23 06:09 bohning

Yes please <3

Would these be different text files? or an extra tag within the same txt file?

You could make it an optional buildflag and provide 2 binaries one with one without

Baklap4 avatar Sep 22 '23 18:09 Baklap4

We can use spleeter to get the vocal track and use it with the #VOCALS and #INSTRUMENTAL to switch vocals on/off for a particular song. Thus no need for a seperate songfile

I know performous can already use this data but rather with #VOCALS and #AUDIO / #MP3 by using the shortcut ctrl + v

Spleeter can run locally, but we could also add in a option to talk with their api? https://github.com/deezer/spleeter/wiki/4.-API-Reference

Baklap4 avatar Sep 03 '24 12:09 Baklap4

There is already an instrumental_version branch that uses demucs. Not sure if demucs or spleeter is better suited for the audio track separating - I went for demucs as it was the recommendation by UltraSinger dev.

bohning avatar Sep 03 '24 12:09 bohning

Oewhh awesome! I'll have look there! Thanks :D

Baklap4 avatar Sep 03 '24 12:09 Baklap4