yuanqian_zhao
yuanqian_zhao
Still unsolved?
same issue
solved, do below instead of `pip install autoawq-kernels`: ``` git clone https://github.com/casper-hansen/AutoAWQ_kernels cd AutoAWQ_kernels pip install -e . ```
how to fix?
are there any solutions? i am confused
maybe few-shot examples are different? what about all 0-shot?
> #648 can now load quantized `lm_head` from `intel/auto-round` but autogptq quantization of lm-head is still in progress. hi! is autogptq quantization of lm-head available now?
hi！is 'look into quantized embeddings' available now? looking forward to this!