metavoice-src icon indicating copy to clipboard operation
metavoice-src copied to clipboard

Phoneme-level pronunciation control

Open danablend opened this issue 11 months ago • 2 comments

Hey! I understand that the text tokens are currently encoded on the character-level and the model is trained with these tokens.

What would be the process for getting phoneme level control over the output audio to correct pronunciations for exotic words or different accents during runtime? One could maybe fine tune models for this, but getting the phoneme level control on the input side would be great.

This would be an amazing add. Would be happy to contribute.

danablend avatar Mar 14 '24 15:03 danablend

Where have you had these kinds of issues? Are you able to share examples?

vatsalaggarwal avatar Mar 14 '24 18:03 vatsalaggarwal

@danablend

I get what you are trying to express. you should try dict TTS

It used a dictionary of pronounciation of exotic words with could of sentence as context. It's a context aware exotic word pronounciation model.

StephennFernandes avatar Apr 28 '24 21:04 StephennFernandes