chainlit
chainlit copied to clipboard
Allow streaming audio responses
trafficstars
Is your feature request related to a problem? Please describe. Whenever I want to use text to speech as a chatbot response, I have to wait for the response from the LLM and then use a TTS service to synthesize the results which results in a huge latency and poor UX experience.
Describe the solution you'd like It would be really cool is cl.Audio/cl.Message allowed streaming of audio tokens so that we can stream TTS response as we get it, instead of waiting to synthesize completely.
Describe alternatives you've considered None at the moment.