Add example on llava quantization

[YIYANGCAI]

Type of Change

Example

[github-actions[bot]]

🌩️ Required checks status: Pending 🟡

Groups summary

🟢 Code Scan Tests workflow

Check ID	Status	Error details
Code-Scan	success		✅
Code-Scan (Bandit Code Scan Bandit)	success		✅
Code-Scan (DocStyle Code Scan DocStyle)	success		✅
Code-Scan (Pylint Code Scan Pylint)	success		✅

These checks are required after the changes to neural_compressor/adaptor/pytorch.py, neural_compressor/adaptor/torch_utils/gptq.py, neural_compressor/adaptor/torch_utils/weight_only.py.

🟡 Model Tests workflow

Check ID	Status	Error details
Model-Test	success		✅
Model-Test (Generate Report GenerateReport)	success		✅
Model-Test (Run ONNX Model resnet50-v1-12)	success		✅
Model-Test (Run PyTorch Model resnet18)	success		✅
Model-Test (Run PyTorch Model resnet18_fx)	success		✅
Model-Test (Run TensorFlow Model darknet19)	no_status		❓
Model-Test (Run TensorFlow Model inception_v1)	no_status		❓
Model-Test (Run TensorFlow Model resnet-101)	no_status		❓
Model-Test (Run TensorFlow Model resnet50v1.5)	success		✅
Model-Test (Run TensorFlow Model ssd_mobilenet_v1_ckpt)	no_status		❓
Model-Test (Run TensorFlow Model ssd_resnet50_v1)	success		✅

These checks are required after the changes to neural_compressor/adaptor/pytorch.py, neural_compressor/adaptor/torch_utils/gptq.py, neural_compressor/adaptor/torch_utils/weight_only.py.

🟢 Unit Tests basic workflow

Check ID	Status	Error details
UT-Basic	success		✅
UT-Basic (Coverage Compare CollectDatafiles)	success		✅
UT-Basic (Unit Test FWKs adaptor Test FWKs adaptor)	success		✅
UT-Basic (Unit Test FWKs adaptor baseline Test FWKs adaptor baseline)	success		✅
UT-Basic (Unit Test ITEX Test ITEX)	success		✅
UT-Basic (Unit Test ITEX baseline Test ITEX baseline)	success		✅
UT-Basic (Unit Test Pruning Test PyTorch Pruning)	success		✅
UT-Basic (Unit Test Pruning Test TensorFlow Pruning)	success		✅
UT-Basic (Unit Test Pruning baseline Test PyTorch Pruning baseline)	success		✅
UT-Basic (Unit Test Pruning baseline Test TensorFlow Pruning baseline)	success		✅
UT-Basic (Unit Test TF newAPI Test TF newAPI)	success		✅
UT-Basic (Unit Test TF newAPI baseline Test TF newAPI baseline)	success		✅
UT-Basic (Unit Test User facing API Test User facing API)	success		✅
UT-Basic (Unit Test User facing API baseline Test User facing API baseline)	success		✅
UT-Basic (Unit Test other basic case Test other basic case)	success		✅
UT-Basic (Unit Test other cases baseline Test other cases baseline)	success		✅

UT-Basic coverage report

	Base coverage	PR coverage	Diff
Lines	84.258%	84.254%	-0.004%
Branches	73.671%	73.662%	-0.009%

These checks are required after the changes to neural_compressor/adaptor/pytorch.py, neural_compressor/adaptor/torch_utils/gptq.py, neural_compressor/adaptor/torch_utils/weight_only.py.

🟢 Unit Tests basic no coverage workflow

Check ID	Status	Error details
UT-Basic-No-Coverage	success		✅
UT-Basic-No-Coverage (Unit Test FWKs adaptor Test FWKs adaptor)	success		✅
UT-Basic-No-Coverage (Unit Test Pruning Test PyTorch Pruning)	success		✅
UT-Basic-No-Coverage (Unit Test Pruning Test TensorFlow Pruning)	success		✅
UT-Basic-No-Coverage (Unit Test User facing API Test User facing API)	success		✅
UT-Basic-No-Coverage (Unit Test other basic case Test other basic case)	success		✅

These checks are required after the changes to neural_compressor/adaptor/pytorch.py, neural_compressor/adaptor/torch_utils/gptq.py, neural_compressor/adaptor/torch_utils/weight_only.py.

🟢 Unit Tests ITREX workflow

Check ID	Status	Error details
UT-ITREX	success		✅

These checks are required after the changes to neural_compressor/adaptor/pytorch.py, neural_compressor/adaptor/torch_utils/gptq.py, neural_compressor/adaptor/torch_utils/weight_only.py.

---

Thank you for your contribution! 💜

Note This comment is automatically generated and will be updates every 180 seconds within the next 6 hours. If you have any other questions, contact chensuyue or XuehaoSun for help.