LLaVA icon indicating copy to clipboard operation
LLaVA copied to clipboard

[Question] Mask targets

Open RunsenXu opened this issue 1 year ago • 0 comments

Question

Hi, a quick question about the implementation of masking targets in train.py L262.

Why does it need to -2 in instruction_len = len(tokenizer(parts[0]).input_ids) - 2?

Thanks!

RunsenXu avatar May 14 '23 15:05 RunsenXu