whisper icon indicating copy to clipboard operation
whisper copied to clipboard

Add support for Intel GPU's

Open leuc opened this issue 2 years ago • 6 comments
trafficstars

Requires Intel Extension for PyTorch v1.13.120+xpu Installation Guide: https://intel.github.io/intel-extension-for-pytorch/xpu/latest/tutorials/installation.html

Successfully tested on Intel ARC A770 16GB VRAM with the large model.

Common issue: OSError: libmkl_intel_lp64.so.2: cannot open shared object file: No such file or directory

Ensure OneAPI libraries are available in the current shell by running source /opt/intel/oneapi/setvars.sh

leuc avatar May 18 '23 15:05 leuc

Can this will be used for Intel Integrated Graphics like Graphics 630 ?

xianlubird avatar May 19 '23 09:05 xianlubird

Can this will be used for Intel Integrated Graphics like Graphics 630 ?

No. From the installation guide the verified Hardware Platforms are:

  • Intel® Data Center GPU Flex Series 170
  • Intel® Data Center GPU Max Series
  • Intel® Arc™ A-Series GPUs (Experimental support)

These are all dedicated GPU's, not integrated.

leuc avatar May 19 '23 09:05 leuc

really appreciate the work. hope it can be merged soon

heligan avatar Aug 23 '23 09:08 heligan

seeing some speed-up for time whisper --language en --model large tests/jfk.flac with new intel_extension_for_pytorch

1.13.120+xpu real 0m23.510s

2.0.110+xpu real 0m19.706s

intel-i915-dkms 1.23.5.19.230406.21.5.17.0.1034+i38-1 kernel 5.17.0-1020-oem

leuc avatar Sep 22 '23 18:09 leuc

Has anyone ran this on integrated graphics with ARC architecture (12th and above I believe?)

cibernox avatar Mar 04 '24 22:03 cibernox