elevenlabs-python icon indicating copy to clipboard operation
elevenlabs-python copied to clipboard

Add Phoneme support to new models

Open bsullins opened this issue 8 months ago • 1 comments

https://elevenlabs.io/docs/api-reference/how-to-use-pronunciation-dictionaries

"Alias tags are supported by all models. Phoneme tags only work with the models eleven_turbo_v2 and eleven_monolingual_v1. If you use phoneme tags with other models, they will silently skip the word."

With monolingual_v2 and multilingual_v2 models I'm seeing better (more human-like) results than turbo_v2, however for my use case I have many words which require custom pronunciations. Currently this does not work.

As a user I would like to use a custom IPA dictionary with the 'eleven_monolingual_v2' and 'eleven_multilingual_v2' libraries so I can produce more human-like audio for my app.

for example:

<lexeme>
    <grapheme>Kia</grapheme>
    <phoneme>/ˈkiːɑ/</phoneme>
</lexeme>

θæŋks!

bsullins avatar Jun 12 '24 15:06 bsullins