r4dm comments

Repositories
Issues
Comments

Results 2 comments of


                                            r4dm

How can I use the Lora Adapter for a model with Vocab size 40960?

same problem, please add support for vocab_size over 32000. in my case need vocab_size 60256

undefined symbol: cquantize_blockwise_fp16_fp4

`cp libbitsandbytes_cuda117.so libbitsandbytes_cpu.so` This method worked for me in WSL Ubuntu on Windows11. I installed anacoda3 and cuda118 special version for `WSL2` FineTuning Vicuna-13B with QloRA works well on RTX4090