xiaojia

step 2 when run "/get_train_lora_grads.sh", load the optimizer.pt error is happend

19

when load the optimizer.pt display the key is different KeyError: 'base_model.model.model.layers.0.self_attn.q_proj.lora_A.default.weight' the items in optimizer.pt state is 0~255.