Mostafa Razavi Ghods issues

Repositories
Issues
Comments

Results 1 issues of


                                            Mostafa Razavi Ghods

ImportError when trying to use 'Linear8bitLt' from 'lit_llama.quantization'

I'm encountering an error while trying to use bitsandbytes in lit-llama. Here's the error message: ``` Loading model ... bin /home/mostafa/anaconda3/envs/ll/lib/python3.11/site-packages/bitsandbytes/libbitsandbytes_cuda117.so Traceback (most recent call last): File "/home/mostafa/programming/lit-llama/generate.py", line 170,...