微调AWQ量化版本的时候报错: awq_ext 未找到

[312shan]

File "/usr/local/lib/python3.10/dist-packages/awq/modules/linear/gemm.py", line 66, in backward
    if awq_ext is None:
NameError: name 'awq_ext' is not defined
  0%|

请问是 awq 的版本的原因吗？以下是我当前版本

autoawq                       0.2.4
autoawq_kernels               0.0.6

[jklj077]

The error (NameError) itself is caused by buggy code in auto-awq. The root cause appears to be the failure in importing the awq_ext module.

Please first check if the requirements at https://github.com/casper-hansen/AutoAWQ_kernels#requirements are met and if you can successfully run python -c "import awq_ext".

[LexieeWei]

@312shan 请问是否解决了，我遇到一样的问题

[codeman0987]

在微调awq量化模型时同样遇到这个问题

[RanchiZhao]

same issue

[RMimo]

same issue

[RanchiZhao]

solved, do below instead of pip install autoawq-kernels:

git clone https://github.com/casper-hansen/AutoAWQ_kernels
cd AutoAWQ_kernels
pip install -e .