WhisperFusion icon indicating copy to clipboard operation
WhisperFusion copied to clipboard

VAD in the client / browser?

Open djmaze opened this issue 1 year ago • 3 comments

Doing VAD on the server makes up for a lot of unnecessary traffic and server load. Why not do it on the client?

Thanks to wasm, Silero VAD can be run entirely in the browser. I am building a similar project to this and am using https://github.com/ricky0123/vad. Judging by my tests, it works really well on desktop as well as mobile devices.

djmaze avatar Feb 05 '24 01:02 djmaze

The main reason is that we use WhisperLive which implements it on the server side, to enable VAD for every client independent from the implementation. We are happy to merge a client side VAD as well, if someone opens a PR.

zoq avatar Feb 05 '24 04:02 zoq

I'm interested in this. Just gonna post here so I can circle back later and see if there's been progress or I can contribute in some way!

kjhenner avatar Feb 25 '24 21:02 kjhenner

@djmaze i am working on a similar project, can we get in touch? [email protected]

sadimoodi avatar Apr 25 '24 07:04 sadimoodi