whisper.cpp icon indicating copy to clipboard operation
whisper.cpp copied to clipboard

Published 20 hours ago • verified publisher icon ggerganov

[Feature Request] Real-time Streaming in WASM

Open jd3655 opened this issue 2 years ago • 2 comments

What you are doing with this project is amazing. The Web Assembly example works great.

Do you think it's possible to use your "Stream" example in Web Assembly? An example using Vosk is here: https://ccoreilly.github.io/vosk-browser/

You can choose real-time streaming or upload a file.

jd3655 avatar Oct 29 '22 12:10 jd3655

Hi, it's possible to port the stream example to WASM, but I doubt the performance is good enough for realtime transcription.

By the way, thanks for showing me Vosk - this looks like a very interesting project. The quality and performance of the WASM demo that you linked is very good.

ggerganov avatar Oct 29 '22 16:10 ggerganov

Just added this: https://whisper.ggerganov.com/stream/

The transcribe step is currently hardcoded at 5 seconds. As expected, it's quite heavy in terms of computation, but it does run on a MacBook.

ggerganov avatar Nov 25 '22 22:11 ggerganov