f2e-spec icon indicating copy to clipboard operation
f2e-spec copied to clipboard

Integration with autotalent plugin to turn every player to a great singer

Open jose1711 opened this issue 4 years ago • 2 comments

Do you want to request a feature or report a bug?

Feature

What did you expect to see?

Quite a few "pop stars" these days use autotune to sound better (and you'll find many examples on youtube). And since they can why we shouldn't too.

There is an early(?) autotune-like plugin for LADSPA called autotalent (http://tombaran.info/autotalent.html). The idea is to offer an alternative gaming mode that would make even the very bad players sing acceptable. This of course has nothing to do with competing against each other so scoring would make no sense.

I have no idea if LADSPA plugins can be controlled from an outside world and also if the latency would still be OK, but the basic idea is:

  • performous continuously reads the current and future note
  • sends this information to autotalent to tune-in (tune to either of these tones)
  • player sings "something" and autotalent corrects the pitch if required

I don't think there is any existing program which would feature this (and maybe there's a reason) but it still could at least be worth consideration.

jose1711 avatar Feb 25 '21 12:02 jose1711

Hmmm i don't see a reason for this to be added in Performous mainly because of the thing that audio-passthrough is horrible the last time i tried it. Correct me if that's not the case anymore as i don't use the functionality... That's one of the reasons i hook up a mixer and reroute the mic input from there to the main out speakers. And if i want i could add a autotune device inbetween to 'fix' the mic-sounds

If we're going to talk about the scoring system where people would see an increased score because of this, i think that beats the whole purpose of the competitive side of performous.

Baklap4 avatar Apr 26 '21 19:04 Baklap4

It would be a good addition and there are commercial games that implement this.

The two main problems are latency (it is very disturbing to hear your own voice delayed, makes articulation almost impossible) and having to reclock the audio for slightly different rates of input and output audio clocks (which the current implementation doesn't do, thus the horrible sound quality). The autotune filter probably can handle dynamic reclocking too and for minimal latency both of these corrections should be done together.

Tronic avatar Apr 27 '21 08:04 Tronic