ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

[Flex170/Whisper]Low GPU usage when running whisper via ipex-llm on Flex170 GPU

Open Yanli2190 opened this issue 7 months ago • 0 comments

Summary:

Steps:

  1. Install ipex-llm following below steps(20240629 is used): conda create -n ipex_llm python=3.9 source activate ipex_llm conda install -c conda-forge -y libstdcxx-ng=12 conda install -c conda-forge -y gperftools=2.10 jemalloc==5.2.1 pip install --pre --upgrade ipex-llm[xpu] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/ pip install datasets soundfile librosa

  2. Run whisper via ipex-llm following run.sh(rename run.txt to run.sh, rename run_whipser_base_perf_dataset.txt to run_whipser_base_perf_dataset.py) run.txt run_whipser_base_perf_dataset.txt

  3. Monitor GPU Usage via xpu-smi image image

Yanli2190 avatar Jun 30 '24 04:06 Yanli2190