WFH

can you try this? https://github.com/juncongmoo/pyllama#%EF%B8%8F-official-way-1

You need to set an env variable probably

Just updated the code base. Can you reinstall pyllama and try?

I can not reproduce the error. It always work for me. 

Try `pip install hiq-python -U` ?

Try `pip install hiq-python -U`.

I will try it tomorrow and update here.

I didn't test on windows 11 but it should work if you have a GPU. Can you double check if your gptq installation is completely successful?

What is the command you ran?

It is safe to approve. Please let me know if there is anything I need to change. Just want to help...