whisper
whisper copied to clipboard
Add support for Intel GPU's
Requires Intel Extension for PyTorch v1.13.120+xpu Installation Guide: https://intel.github.io/intel-extension-for-pytorch/xpu/latest/tutorials/installation.html
Successfully tested on Intel ARC A770 16GB VRAM with the large model.
Common issue:
OSError: libmkl_intel_lp64.so.2: cannot open shared object file: No such file or directory
Ensure OneAPI libraries are available in the current shell by running source /opt/intel/oneapi/setvars.sh
Can this will be used for Intel Integrated Graphics like Graphics 630 ?
Can this will be used for Intel Integrated Graphics like Graphics 630 ?
No. From the installation guide the verified Hardware Platforms are:
- Intel® Data Center GPU Flex Series 170
- Intel® Data Center GPU Max Series
- Intel® Arc™ A-Series GPUs (Experimental support)
These are all dedicated GPU's, not integrated.
really appreciate the work. hope it can be merged soon
seeing some speed-up for time whisper --language en --model large tests/jfk.flac with new intel_extension_for_pytorch
1.13.120+xpu real 0m23.510s
2.0.110+xpu real 0m19.706s
intel-i915-dkms 1.23.5.19.230406.21.5.17.0.1034+i38-1 kernel 5.17.0-1020-oem
Has anyone ran this on integrated graphics with ARC architecture (12th and above I believe?)