typebot.io icon indicating copy to clipboard operation
typebot.io copied to clipboard

Autoplayed audio URL attached to text bubble

Open Usouf opened this issue 1 year ago • 4 comments

Is your feature request related to a problem? Please describe. The feature is not associated with a problem, rather it is an additional feature that can provide a better conversational experience with the chatbot

Describe the solution you'd like It would be great if we could configure the text bubble where we show the bot's response to have some sort of text-to-speech feature available. This will allow the users to have a natural conversation with the bot making it a better experience.

Describe alternatives you've considered I did a workaround using eleven labs where I sent the bot's response to eleven labs -> got the audio file -> and showed the audio file in the audio bubble with auto-play enabled. The issue with this solution is that the text and audio file are different bubbles and you replay the audio file. It would be better if the audio played along with the text bubble without having to add an audio bubble.

In this case, we will have to configure either eleven labs or OpenAI to generate speech from the response and play it with the text bubble.

Usouf avatar Nov 21 '24 12:11 Usouf

I'm not sure to understand the benefit of having both audio and text?

baptisteArno avatar Nov 23 '24 13:11 baptisteArno

It is basically to help impaired people interact with the chatbot where they can hear the response if not they can read it and vice versa

Usouf avatar Nov 26 '24 06:11 Usouf

Then this could be an option to attach an audio URL to a text bubble with a audio icon on the top right corner of the text bubble

But I won't lie, I find this very niche and I don't see myself work on this in the near future 🙏

Open to contributors!

baptisteArno avatar Nov 26 '24 09:11 baptisteArno

"you can explore the text-to-speech capabilities you're looking for at www.nemesyslabs.com, a free and accessible platform that doesn't require accounts or lists of models."

DomoMKT avatar Feb 03 '25 12:02 DomoMKT