Neo Zhang Jianyu

@ei-grad Could you share the cmd to install ITREX? It's great if you could provide the whole log with this error.

@ZhangShuoAlreadyExists We will check it and feedback as soon!

@ZhangShuoAlreadyExists I create an example as your code. It's passed. Could you refer to it? Install packages: ``` pip install neural_compressor pip install torch torchvision onnxruntime onnx ``` Code: ```...

@ZhangShuoAlreadyExists Could you confirm if our answer support you? Thank you!

@barolo Could you try with example mode file: llama-2-7b.Q4_0.gguf? It will help check the soft/hard ware in your PC. I'm not sure it working well with llama-2-7b.Q4_K_S.gguf in your case....

@barolo 1. Could you share the whole log? 2. sycl-ls share the output. Thank you!

the log include the content from input cmd to final error appear.

Your fault log is about model: /home/greggy/Develo/D/models/llama-2-7b.Q4_K_S.gguf Could you try llama-2-7b.Q4_0.gguf? I want to confirm your issue is about model or hardware/software env.

@dikei100 What's the hardware info of your case? I guess it's MTL Arc iGPU. What's the OS? I don't reproduce your case. But my driver is 1.3.28202, your is 1.3.28717.

I borrow a laptop with Meteor Lake with latest windows driver: 1.3.29283. It's OK. But I have no Linux Meteor Lake to verify it. I will verify it on Arc...