ZLUDA
ZLUDA copied to clipboard
Is zluda not support bitsandbytes ?
I kind of confused cause I didn't find any info about bitsandbytes in zluda, as I know:
- bitsandbytes work on cuda, if needed to be used in amd gpu, needed to download the source code to compile;
- That's a rocm or an similar branch, can compile in linux+amd+rocm, I get it done in wsl2;
- I tried
pip install bitsandbytesin window+amd+zluda, and it will get error somehow.
The question is, how can I use bitsandbytes with window zluda ? Still use the rocm branch to compile cause zluda also relates to hip/rocm ? Or just use the master branch to compile with cuda ? Install the cudatoolkit ? Or it just not work, I can't use bitsandbytes in zluda ?
PyTorch support is still a work in progress, when we will have pytorch support you will be able to run various pytorch-based software