Matthew Douglas

Hi @fantasy-fish Thanks for reporting. This looks to be a bug in the diagnostics that are run with `python -m bitsandbytes`. At runtime these full diagnostics are not conducted, so...

Hi all, I can reproduce this too. But if I start making some changes to the text, or the generation strategy, I do start to get other results. **Default** question...

There have now been some documentation updates both for the inline docstrings and the markdown-format public docs. Additionally, tests related to 8bit now use static shapes. Certain tests related to...

Benchmark details have been added. I've also confirmed that everything is working on V100 without the separate NO_CUBLASLT build needed.

Hi @junzhang-zj Can you let us know what versions of bitsandbytes, transformers, and PEFT that you are using?

This should be resolved in [PEFT#2245](https://github.com/huggingface/peft/pull/2245) and bitsandbytes 0.45.0. Feel free to raise again if necessary.

Hi @chenqianfzh, Thanks for reporting this issue. I believe that I see the same behavior with the 8bit version `matmul` as well. For the 4bit version, this may work as...

Hi @ACMCMC, None of the releases are supported on macOS yet. Releases up through 0.42.0 were incorrectly tagged as supporting all platforms, but this was an oversight. Those older wheels...

Hi everyone, Please see the [discussion here on Apple Silicon support](https://github.com/bitsandbytes-foundation/bitsandbytes/discussions/1340). Bitsandbytes does not currently support macOS, but we're looking for contributions to make that happen!

> Wait I don't think Python 3.13 is supported yet! Maybe that's the issue. I'm not 100% sure though This is indeed the case for `sentencepiece` - there's no Python...