ipex-llm
ipex-llm copied to clipboard
[Flex170/Whisper]Low GPU usage when running whisper via ipex-llm on Flex170 GPU
Summary:
Steps:
-
Install ipex-llm following below steps(20240629 is used): conda create -n ipex_llm python=3.9 source activate ipex_llm conda install -c conda-forge -y libstdcxx-ng=12 conda install -c conda-forge -y gperftools=2.10 jemalloc==5.2.1 pip install --pre --upgrade ipex-llm[xpu] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/ pip install datasets soundfile librosa
-
Run whisper via ipex-llm following run.sh(rename run.txt to run.sh, rename run_whipser_base_perf_dataset.txt to run_whipser_base_perf_dataset.py) run.txt run_whipser_base_perf_dataset.txt
-
Monitor GPU Usage via xpu-smi