ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

Published 20 hours ago • verified publisher icon intel-analytics

GPTQ inference issue on intel gpu

Open a32543254 opened this issue 1 year ago • 3 comments

image when I run gptq model on intel gpu, I meet above error. Could you kindly to help to solve.

a32543254 avatar Apr 12 '24 09:04 a32543254

image when I run gptq model on intel gpu, I meet above error. Could you kindly to help to solve.

The system is Meteor Lake (MTL)

a32543254 avatar Apr 12 '24 09:04 a32543254

Sorry if this is stating the obvious, but...did you run source /opt/intel/oneapi/setvars.sh first?

digitalscream avatar Apr 13 '24 14:04 digitalscream

Could you provide env information using https://github.com/intel-analytics/ipex-llm/tree/main/python/llm/scripts?

liu-shaojun avatar Apr 15 '24 02:04 liu-shaojun