yunzhongyan0 comments

Repositories
Issues
Comments

Results 4 comments of


                                            yunzhongyan0

Illegal instruction (core dumped) when trying to run with nGraph-TensorFlow bridge

I have the same problem. Have you solved it?

[Feature] Any Plan to implement INT8 weight-only quantizaton

> We have tested the performance of INT4 weight-only quantization on OpenCompass. According to the results, the performance of INT4 quantization is on par with FP16. > > If you...

[Feature] Any Plan to implement INT8 weight-only quantizaton

ok. another question, awq quantization can provide a function that use own data not open data like 'c4' ?

pip install flash-attn always happens ModuleNotFoundError: No module named 'packaging',but actually i have pip install packaging

> > > Try this: > > > > pip install -U wheel > > > > > > someone reported this worked in their environment. > > but when...