WhisperFusion
WhisperFusion copied to clipboard
Running outside Docker
Any instructions for installing this without needing Docker?
I setup a new Python environment with these commands
python -m pip install --upgrade pip
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts wheel==0.41.2
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts faster-whisper==0.9.0
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts websockets==12.0
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts onnxruntime==1.16.0
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts ffmpeg-python==0.2.0
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts scipy==1.12.0
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts websocket-client==1.7.0
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts tiktoken==0.3.3
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts kaldialign==0.7.2
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts braceexpand==0.1.7
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts openai-whisper==20231117
python.exe -m pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts whisperspeech==0.6
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts soundfile==0.12.1
pip uninstall -y torch
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts torch==2.1.1+cu118 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118
I change into the examples/chatbot/html
directory and run python -m http.server
I can open the webpage and click the microphone, but when I speak it is not recognised and/or shown.
What else do I need to run outside Docker?
@SoftologyPro Okay, to run outside docker a few things:
-
setup your cuda environment,
cuda 12.3
preferably -
And install dependencies by running the
docker/base-image/install-deps.sh
-
Next install
tensorrt-llm
by runningdocker/base-image/install-trt-llm.sh
-
If everything works as expected, you only need to convert
whisper
andphi
to tensorrt. Use the scripts we provide for the same.
@makaveli10
May i ask how you build this docker image? http://ghcr.io/collabora/whisperbot-base:latest