neural-compressor

neural-compressor copied to clipboard

AWQ Quantization padding error

1

[Line 474 in weight_only.py](https://github.com/intel/neural-compressor/blob/24419c9044fe227ea806db370c1a30272d026f8a/neural_compressor/adaptor/ox_utils/weight_only.py#L474C37-L474C43) is trying to pad the the tensor so that the first dimension is divisible by the block size. The problem is that instead of passing the...

PatriceVignola

io.UnsupportedOperation: fileno

1

Hi, I ran the resnet based quantization notebook. I am getting the following error. Please suggest me to solve this issue. Used !pip install tensorflow==2.12.0 !pip install neural-compressor==2.3.2 ``` 2024-04-03...

jashokkumar83

## Type of Change Use google coding style for ONC ## Description detail description ## Expected Behavior & Potential Risk the expected behavior that triggered by this PR ## How...

mengniwang95

Enhance 3.x common logger and update 3.x torch example

1

## Type of Change example API changed or not: no ## Description Update 3.x torch example and enhance 3.x common logger information. Smooth quant uses quantize(), others use prepare() +...

yuwenzho

[Not merge]Test 2.x model-test

1

## Type of Change feature or bug fix or documentation or validation or others API changed or not ## Description detail description ## Expected Behavior & Potential Risk the expected...

yiliu30

## Type of Change Smoothquant refactor for 3.x API API changed ## Description - [x] refactor new API - prepare/convert - [ ] add ut for new API, remove unnecessary...

violetch24

fix awq padding issue

1

## Type of Change bug fix ## Description https://github.com/intel/neural-compressor/issues/1699 ## Expected Behavior & Potential Risk the expected behavior that triggered by this PR ## How has this PR been tested?...

mengniwang95

## Type of Change feature ## Description Support save/load API for WOQ remove export_compressed_model from config ## Expected Behavior & Potential Risk the expected behavior that triggered by this PR...

Kaihui-intel

Fix onnxrt backend recover function

1

## Type of Change bug fix ## Description the q_config of tuning history is wrong in performance only mode ## How has this PR been tested? UT

mengniwang95

Support `auto_round` integration 2.x

1

## Type of Change feature ## Description detail description ## Expected Behavior & Potential Risk the expected behavior that triggered by this PR ## How has this PR been tested?...

Kaihui-intel