DeepSpeedExamples icon indicating copy to clipboard operation
DeepSpeedExamples copied to clipboard

Wrong import in inference quantization example

Open Epliz opened this issue 1 year ago • 1 comments

Hi,

At https://github.com/microsoft/DeepSpeedExamples/blob/master/inference/huggingface/zero_inference/README.md , the referenced import from deepspeed.compression.inference.quantization import _init_group_wise_weight_quantization is wrong. The correct one is from deepspeed.inference.quantization import _init_group_wise_weight_quantization .

Can you please correct it? Best regards, Epliz

Epliz avatar Oct 17 '23 07:10 Epliz