wangyan comments

Repositories
Issues
Comments

Results 2 comments of


                                            wangyan

"cublasLt ran into an error" with older GPU in 8-bit mode

try rebuild bitsandbytes from https://github.com/TimDettmers/bitsandbytes my env ：GeForce3090 Driver Version: 510.47.03 CUDA Version: 11.6 【fix todo】 git clone https://github.com/timdettmers/bitsandbytes.git cd bitsandbytes CUDA_VERSION=116 make cuda116 python setup.py install

There were missing keys in the checkpoint model loaded

old_state_dict = model.state_dict state_dict = ( lambda self, *_, **__: get_peft_model_state_dict( self, old_state_dict() ) ).__get__(model, type(model))() set_peft_model_state_dict(model, state_dict)