Cheng, Penghui comments

Repositories
Issues
Comments

Results 11 comments of


                                            Cheng, Penghui

Support Weight-Only quantization on CPU device with QBits backend

Below is the performance benchmark with examples/benchmark.py, this performance is based on the master branch of intel-extension-for-transformers(ITREX) repo, and in the latest code of ITREX, the QBits was updated to...