whisper.cpp icon indicating copy to clipboard operation
whisper.cpp copied to clipboard

Guided mode for the "command" example

Open ggerganov opened this issue 2 years ago • 0 comments

ref #190 #235

"Guided mode" allows you to specify a list of commands (i.e. strings) and the transcription will be guided to classify your command into one from the list. This can be useful in situations where a device is listening only for a small subset of commands.

Initial tests show that this approach might be extremely efficient in terms of performance, since it integrates very well with the "partial Encoder" idea from #137.

https://user-images.githubusercontent.com/1991296/207435352-8fc4ed3f-bde5-4555-9b8b-aeeb76bee969.mp4

ggerganov avatar Dec 13 '22 17:12 ggerganov