ZLUDA icon indicating copy to clipboard operation
ZLUDA copied to clipboard

Is zluda not support bitsandbytes ?

Open lotaway opened this issue 2 months ago • 1 comments

I kind of confused cause I didn't find any info about bitsandbytes in zluda, as I know:

  1. bitsandbytes work on cuda, if needed to be used in amd gpu, needed to download the source code to compile;
  2. That's a rocm or an similar branch, can compile in linux+amd+rocm, I get it done in wsl2;
  3. I tried pip install bitsandbytes in window+amd+zluda, and it will get error somehow.

The question is, how can I use bitsandbytes with window zluda ? Still use the rocm branch to compile cause zluda also relates to hip/rocm ? Or just use the master branch to compile with cuda ? Install the cudatoolkit ? Or it just not work, I can't use bitsandbytes in zluda ?

lotaway avatar Oct 10 '25 17:10 lotaway

PyTorch support is still a work in progress, when we will have pytorch support you will be able to run various pytorch-based software

vosen avatar Oct 10 '25 18:10 vosen