Heng Guo

qat examples with new api

4

## Type of Change Add and update qat examples with new api Include: * resnet50 * resnet50v2 * resnet101 * resnet101v2 * dense169 * mobilenet_v2 ## Description JIRA: https://jira.devtools.intel.com/browse/ILITV-2209 ##...

h2o for kv cache compression

1

## Type of Change feature ## Description H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models [paper](https://arxiv.org/pdf/2306.14048.pdf) NTD - [x] example - [ ] refactor code to same...

add some new features for layer-wise quant

1

## Type of Change feature ## Description add some new features for layer-wise quant, include get_weight, get_bias, update, and save/load. Make it more easy to use, like a normal model....

porting sq to autoround

1

- [ ] example - [ ] api - [ ] remove duplication process/code, increase running speed - [ ] evaluation on few models - [ ] tune alpha /...