agents icon indicating copy to clipboard operation
agents copied to clipboard

Azure multilingual STT does not work as expected

Open meetakshay99 opened this issue 4 months ago • 0 comments

I want to use Azure STT with passing a list of languages that the input audio could be from. I want Azure to identify the language from the provided list for the provided input audio.

stt = azure.STT(
           languages=["en-GB","hi-IN","fr-FR","de-DE","ar-AE","zh-CN","it-IT"]
         )

VoicePipelineAgent(
            vad=ctx.proc.userdata["vad"],
            stt=stt,
            llm=llm,
            tts=tts,
            chat_ctx=initial_ctx
        )

In above case the interim and final results are NOT received.

However, if I don't pass the languages param then Azure STT works but it always detects language as "en-US" irrespective of what language I speak in.

Please let me know what should be done to get Azure multilingual STT to work correctly. Any help is appreciated. Thanks.

meetakshay99 avatar Oct 24 '24 08:10 meetakshay99