sayhellotoAI2

hi @williamLyh , ``` for name, param in model.named_parameters(): if 'lora' in name or 'Lora' in name: param.requires_grad = True ``` this will help you :)

in my case, llama2 model print(model.config.pad_token_id,"\n",model.config.eos_token_id) returns None and 32000 so change "pad_token=model.config.pad_token_id" to "pad_token=model.config.eos_token_id," in generation config works to me