Matthew Douglas

Hi @ZeroneBo, You will need to also build the libbitsandbytes using `cmake` as outlined in the docs. This does not currently happen when you use `pip install`. Since there has...

Hi, At the moment the paged 8bit optimizer is not supported with FSDP. Relates to: #89

Hi @alexgit256, Make sure to install NumPy 1.x, using `pip install numpy

Hi, For nf4 quantization we only support computation with fp32, fp16, or bf16. We also do not quantize the activations. Can you clarify by what you mean with edge devices...

Hi @LukeLIN-web, I was not able to reproduce this on an RTX 4090. That said, I would also expect it to work on a 2080 Ti, as that GPU is...

Hi @LukeLIN-web, Thank you for providing detailed information. Upon reviewing the details of the issue, it appears that the problem might not be directly related to the bitsandbytes library. I...

We haven't had any immediate plans for this, but if it is useful to the community then we can consider it. I'm making the assumption here that we're talking about...

Hi @dami1018, We weren't able to include a CUDA 12.4 specific build for Windows at the time of the last releases, and only had this enabled for Linux. We'll include...

This is expected. When you build from source it will use the CUDA toolkit installed on your system. At runtime it will try to link with a binary versioned with...

We released [bitsandbytes 0.45.3 wheels](https://github.com/bitsandbytes-foundation/bitsandbytes/releases/tag/0.45.3) with CUDA 12.8 builds for Blackwell yesterday.