seamless_communication icon indicating copy to clipboard operation
seamless_communication copied to clipboard

Streaming audio S2TT Example/Guidance

Open SeeRich opened this issue 1 year ago • 4 comments

I am interested in streaming audio chunks and performing continuous S2TT. Is this possible with the current code? If so, any guidance would be much appreciated!

SeeRich avatar Aug 24 '23 00:08 SeeRich

@SeeRich it's not possible with the current code AFAIK.

jmp84 avatar Aug 24 '23 03:08 jmp84

We don't have support for streaming translation yet.

kauterry avatar Aug 25 '23 15:08 kauterry

Why close this issue. It's an important feature request. :-)

fishfree avatar Sep 26 '23 01:09 fishfree

This is supported with SeamlessStreaming models, see https://github.com/facebookresearch/seamless_communication/?tab=readme-ov-file#seamlessstreaming, see also the colab at https://fb.me/mt-neurips for an example of standalone inference or the demo code at https://huggingface.co/spaces/facebook/seamless-streaming/blob/main/README.md

annasun28 avatar Jan 05 '24 20:01 annasun28