neural-compressor

neural-compressor copied to clipboard

Support true sequential options in gptq

2

## Type of Change Feature

YIYANGCAI

Enable Llama MoE models' GPTQ quantization

1

## Type of Change new feature

YIYANGCAI

neural_compressor/adaptor/ox_utils/quantizer.py dfs crash during "basic" tuning

1

When I use "basic" strategy tuning to quantize my model, I ran into this issue during one of the phases: ``` ... 2024-02-21 23:25:49 [INFO] Tune 73 result is: [Accuracy...

kmn1024

## Type of Change Examples ## Description Examples for HQQ ## How has this PR been tested? Local test

yiliu30

## Type of Change Add ipex xpu examples ## Description - [ ] ResNet50 - [ ] yolo - [ ] gptj - [ ] llama2 ## Expected Behavior &...

violetch24

## Type of Change Example code ## Description Dreambooth is a method customize text-to-image models like Stable Diffusion with a few (3-5) images of a subject. This example illustrates how...

nazneenn

Extend SmoothQuant support (exclude nodes, fuse into layernorm)

8

## Type of Change As per title. ## Description This PR includes two new features for SmoothQuant (that I was too lazy to split into two PRs): * Add the...

fxmarty

Resolve transformer version dependencies and refine the sparseGPT exa…

2

…mple ## Type of Change feature or bug fix or documentation or validation or others API changed or not ## Description detail description ## Expected Behavior & Potential Risk the...

WeiweiZhang1

support bias shift in outlier suppression+

2

## Type of Change feature ## Description enable bias-shifting of outlier suppression + in SQ Note: this is still under development and debugging ## Expected Behavior & Potential Risk ##...

yintong-lu

Add RFC dir for submission tracking

1

## Type of Change Documentation for RFC submission ## Description This is a proposed RFC for DeepSpeed/INC integration

ftian1