lora-instruct icon indicating copy to clipboard operation
lora-instruct copied to clipboard

Error message when training MPT-7B

Open jianchaoji opened this issue 1 year ago • 2 comments

Hi I got a message when I try to use Lora to train MPT-B, do you have any ideas to solve it?

ValueError: Unable to create tensor, you should probably activate truncation and/or padding with 'padding=True' 'truncation=True' to have batched tensors with the same length. Perhaps your features (instruction in this case) have excessive nesting (inputs type list where type int is expected).

jianchaoji avatar Jun 01 '23 23:06 jianchaoji