nanxue comments

Results 3 comments of


                                            nanxue

ImportError: Using `bitsandbytes` 8-bit quantization requires Accelerate: `pip install accelerate` and the latest version of bitsandbytes: `pip install -i https://pypi.org/simple/ bitsandbytes`

> @DaveChini Am having the same issue. But when i print its similar to +cu only. 2.1.2+cu121 but am having the same error any help? > > I have the...

ImportError: Using `bitsandbytes` 8-bit quantization requires Accelerate: `pip install accelerate` and the latest version of bitsandbytes: `pip install -i https://pypi.org/simple/ bitsandbytes`

> > @DaveChini Am having the same issue. But when i print its similar to +cu only. 2.1.2+cu121 but am having the same error any help? > > > >...

Memory and time requirements for Mistral-7B

> Update --- The error comes from initializing torch.zeros(), below is the tracestack. > > ``` > Traceback (most recent call last): > File "/home/ubuntu/Compress_Align/wanda/main.py", line 113, in > main()...