Matthew Douglas

> #1220 will fix this issue. I don't recall seeing any optimizers implemented yet for CPU, but may be mistaken. Paged optimizer doesn't make sense to me for CPU, but...

Hi, I am closing this issue as it is stale. We've since made improvements to the packaging and setup of the library. Please open a new issue for further support...

Hi all, Does this issue remain with v0.45.0 and the latest PEFT? Happy to revisit it if so!

@msaroufim See #951, likely Windows/MSVC. Very similar issue to the changes made in FP6 which used some non-standard types like 'u_int8_t`.

We noticed that there has been no recent activity on this issue. As a result, we will be closing it for now. If you continue to experience this problem or...

@ArthurZucker Ready!

@ArthurZucker I've added more background to the description. > The issue we encountered was specific to our cluster environment on AWS. With the [AWS EFI plugin for NCCL](https://github.com/aws/aws-ofi-nccl), we encountered...

Thanks @SunMarc! I've tested moving between gpu->cpu->gpu, but not yet on multiple GPUs. We'll still see a warning from accelerate: > You shouldn't move a model that is dispatched using...

Reference note: this should fix #24540 for 4bit. For 8bit there is still a blocker: bitsandbytes-foundation/bitsandbytes#1332; once that's fixed & released on the bitsandbytes side we can do an additional...

This should be fixed with #32276. Related: #31577