neural-compressor icon indicating copy to clipboard operation
neural-compressor copied to clipboard

Will you support Intel Arc?

Open nathanodle opened this issue 1 year ago • 2 comments

I’m curious if you will support Arc, neural compressor would particularly benefit those platforms! Thanks!

nathanodle avatar Dec 29 '23 20:12 nathanodle

We support general quantization/inference for Arc based on IPEX and ITEX. Here is an example for IPEX: https://github.com/intel/neural-compressor/blob/master/examples/pytorch/nlp/huggingface_models/question-answering/quantization/ptq_static/ipex/README.md#2-quantization-with-xpu
Example for ITEX: https://github.com/intel/neural-compressor/blob/master/examples/tensorflow/nlp/bert_base_mrpc/quantization/ptq/README.md#quantizing-the-model-on-intel-gpumandatory-to-install-itex https://github.com/intel/neural-compressor/blob/master/examples/tensorflow/nlp/bert_base_mrpc/quantization/ptq/README.md#quantization-config
Quantization steps are similar to CPU, just some config difference. The complex part is how to setup a XPU working ENV with IPEX/ITEX.

chensuyue avatar Jan 04 '24 09:01 chensuyue

OK thanks. In that case you may want to update the readme?

image

Thanks for the response!

nathanodle avatar Jan 04 '24 15:01 nathanodle

No plan to claim formal support on ARC due to limited scope of validation. Close this issue for now.

thuang6 avatar Apr 26 '24 06:04 thuang6