LESS icon indicating copy to clipboard operation
LESS copied to clipboard

Published 20 hours ago • verified publisher icon princeton-nlp

step 2 when run "/get_train_lora_grads.sh", load the optimizer.pt error is happend

Open victorjiax opened this issue 1 year ago • 19 comments

when load the optimizer.pt display the key is different KeyError: 'base_model.model.model.layers.0.self_attn.q_proj.lora_A.default.weight'

the items in optimizer.pt state is 0~255.

victorjiax avatar Feb 23 '24 09:02 victorjiax