try nova-3 by deepgram

[kodjima33]

deepgram released nova-3 for multi-languages. let's try it

[abhayguptas]

it's currently under the beta access. if you have the access of the beta then let me know. i would like to work on the implementation.

[abhishek818]

@kodjima33 running backend shows up invalid imports issue:

File "/Users/abhishekkumargupta/Desktop/open_source/omi/backend/main.py", line 7, in from modal import Image, App, asgi_app, Secret ImportError: cannot import name 'Image' from 'modal' (unknown location)

Dont find these vars in modal module..

[abhishek818]

anyways, adding the option/param - "model='nova-3'" should be enough.

[aliveevie]

I want to try this

[Serdnad]

According to the latest docs, Nova 3 multilingual support is still coming soon :/

related deepgram issues [1, 2]

[kodjima33]

ok closing

[beastoin]

@Serdnad could you find any replacements ?

[kodjima33]

@beastoin need to try their new beta multi-language model - they've gave the access (check email)

[beastoin]

on-it @kodjima33 / @thainguyensunya feel free to update the progress here a ;)

[thainguyensunya]

Hi Folks,

The implementation to try Nova-3 multi languages has been deployed to Dev env. Currently Nova-3 multi languages support 10 languages: English, Spanish, French, German, Hindi, Russian, Portuguese, Japanese, Italian, and Dutch

If the input language from user is in the supported languages list, the STT will use Nova-3 model, otherwise it will use old Nova-2-general model

[beastoin]

notes:

--

sorry guys, the deepgram beta is not good enough to launch on omi production env - poor performance, ~1 concurrents connection on streaming.

close for now.

--

next: #1892

[beastoin]

hi a @thainguyensunya , please try the deepgram self-hosted

[thainguyensunya]

Hi @beastoin

Please help to review the draft PR#2152. The change is also deployed to dev environment.