AIwaifu icon indicating copy to clipboard operation
AIwaifu copied to clipboard

Emotion Analysis Of Conversantion/Waifu algorithm idea?

Open HRNPH opened this issue 1 year ago • 2 comments

for now, I'm thinking of training sentiment classification on multiple classes we will then use the top Log(probability) on each neuron as a combination of emotions ['Joy', 'Mad'] the model that I currently use for prototyping contains a little emotion but due to the complex emotion that can be expressed in the real conversation such as Tsundere(actually happy but speaking as if they're mad: BLUSHING I hate you! (Maybe recognizable if you took a whole conversation as features) this issue was opened for the suggestion of a better Conversation -> Emotion algorithm

HRNPH avatar Apr 11 '23 19:04 HRNPH

I think sentiment classification is quite good because it also doesn't take too much memory, the challenge might be to label the data set with more classes like shy, tsundere and many other expressions.

andri-jpg avatar Apr 22 '23 17:04 andri-jpg

yeah, I think maybe I need to make some datasets myself for fine-tuning some Sentiment Classification but for now, I'll focus on solid development of base TTS/Voice Conversion Model there's still documentation & training scripts to be released

HRNPH avatar Apr 22 '23 18:04 HRNPH