nativescript-speech-recognition icon indicating copy to clipboard operation
nativescript-speech-recognition copied to clipboard

Continuous Speech Recognition

Open tylerablake opened this issue 7 years ago • 3 comments

More of a question than a bug I think but hopefully you can help.

Is there any way to get the plugin to do continuous speech recognition listening for a keyword or only able to operate by push to talk for now? How should I handle enable/disable speech recognition while device is trying to play audio then re-enable after device response is done?

I am hoping to use this plugin in an app but having trouble getting it to run on a device while using NativeScript-texttospeech plugin to respond after keywords are recognized but after the texttospeech plugin starts responding, the app crashes. I believe due to input/output busses fighting over each other..

Thanks for your help!

tylerablake avatar Aug 06 '18 16:08 tylerablake

I have the very same problem. I worder if is it possible to configure the silent period for both platfforms. About the nativescript-texttospeech I am not using.

Clifte avatar Oct 09 '18 18:10 Clifte

Same problem here, I would like my app to react to a specific keyword. Thanks a lot for your great work!

EDIT: after doing more research, continuous speech recognition does not seem to be allowed natively neither on apps nor on web browser apps. I see two more options:

  • streaming continuously to a third-party online speech recognition service (cons: may drain the battery)
  • train a machine learning model and run it on the device, for example, see: https://www.npmjs.com/package/@tensorflow-models/speech-commands (cons: require knowledge in data science)

nicolasfguillaume avatar Mar 29 '20 08:03 nicolasfguillaume

Any further work with this?? At the moment I have the continuous voice and then based on the string then check if a certain word is matched and if it is the case then run commands. However this is very buggy...

liamcharmer avatar Aug 19 '21 16:08 liamcharmer