WhisperFusion
WhisperFusion copied to clipboard
collabora
WhisperFusion builds upon the capabilities of WhisperLive and WhisperSpeech to provide a seamless conversations with an AI.
When running the Demo on Mac on Chrome, the code was not entirely correct. Firstly, whisper-live has some bugs with a buffer overflowing on macs. This was fixed on the...
I try to run this project on AWS EC2 g4dn.xlarge with T4 GPU and I got AttributeError as below ``` ========== == CUDA == ========== CUDA Version 12.2.2 Container image...
In the file [trt_server.py](https://github.com/collabora/WhisperFusion/blob/main/whisper_live/trt_server.py#L340-L343) I suspect that the highlighted lines need to be in the same indentation level as the `while` loop. Otherwise, in its current form it makes no...
Doing VAD on the server makes up for a lot of unnecessary traffic and server load. Why not do it on the client? Thanks to wasm, Silero VAD can be...
### The Objective Basically folks are having trouble deploying whisperfusion locally using command-line / docker , therefore we can actually help them quite a lot by including one-click (cloud) deploy...
### Objective - showcase the speed and quality of whisperfusion style applications using the huggingface Agents library. ### Tasks - Wrap WhisperFusion with huggingface/transformers/agents for compatibility - add cool tools...
- add docker compose - remove nginx setup from whisperfusion dockerfile - remove build.sh, publish.sh to build and push images to ghcr.io
Hey, love this repo. Thank you so much for this work. Can you clarify what license your code has? I couldn't confirm if it is MIT or not. Putting a...
I tried to run the latest (as of today) docker image: `docker run --gpus all --shm-size 64G -p 8001:80 ghcr.io/collabora/whisperfusion:latest` Im getting the error `OSError: /usr/local/lib/python3.10/dist-packages/tensorrt_llm/libs/libth_common.so: undefined symbol: _ZN3c1017RegisterOperatorsD1Ev`. See...
