Jie

icon location Ph.D. The Chinese University of Hong Kong

Results 2 comments of Jie

Random Training

> Oh did you set `random_state = 3407` in `FastLanguageModel.get_peft_model`? Yes! I set the seed many times: 1st: from transformers import set_seed as transformers_set_seed transformers_set_seed(3407) 2nd: model = FastLanguageModel.get_peft_model( model,...

peft微调llama3 8b，从第10补开始loss一直都是0

tokenizer.pad_token = tokenizer.eos_token 为啥需要这样啊