OBS-captions-plugin icon indicating copy to clipboard operation
OBS-captions-plugin copied to clipboard

Multilingual speech recognition

Open Siphonay opened this issue 2 years ago • 3 comments

Hello! I stream in English and French, both one or the other in one stream but there’s always a possibility that I utter a phrase in the other language e.g. to address someone in chat, or whatever, but when that happens, the caption come off as gibberish as they can only detect one language at a time.

In the documentation for Google Cloud’s speech recognition API, there is a mention of an alternativeLanguageCodes parameter to send to the request to detect additional languages: https://cloud.google.com/speech-to-text/docs/multiple-languages

Do you think this is something that could be integrated to the plug-in? It would absolutely be of great use for me and I’m sure many bilingual streamers.

Siphonay avatar Jun 10 '22 01:06 Siphonay

I also do this French and English combo and it would be really nice

Julienraptor01 avatar Jul 15 '22 00:07 Julienraptor01

My understanding is that this plugin uses the "old" Cloud/Google STT, which lacks many of the new Cloud features (but also the cost).

bost-ty avatar Oct 28 '22 21:10 bost-ty

At the very least, it'd be nice to have support for a hotkey to switch between multiple languages on the fly.

Nixill avatar Nov 15 '23 01:11 Nixill