sepia-docs icon indicating copy to clipboard operation
sepia-docs copied to clipboard

Does Sepia have the ability to understand domain specific knowledge?

Open gabrielcolon32 opened this issue 2 years ago • 1 comments

Hi! Does Sepia have the ability to understand domain specific knowledge and commands? More specifically: could you train Leon and optimize it to only understand commands related to let's say, setting up a timer or ordering a pizza?

gabrielcolon32 avatar Oct 31 '21 00:10 gabrielcolon32

Hi, SEPIA's NLU chain is modular. You could deactivate the rules-based part that controls most of the integrated services and replace it with your own NLU (e.g. with the python-bridge), write your own lists of static commands or partially deactivate services. Besides that I'm currently experimenting with domain-specific voice-widgets that you can activate with a specific command (e.g. "start medi bot") and then redirect all input into one specific service. In theory each voice-widget could also use it's own speech-recognition model. Its a bit like an Alexa app that you can switch on and off.

fquirin avatar Oct 31 '21 19:10 fquirin