LLaVA
LLaVA copied to clipboard
[Question] Mask targets
Question
Hi, a quick question about the implementation of masking targets in train.py L262.
Why does it need to -2
in instruction_len = len(tokenizer(parts[0]).input_ids) - 2
?
Thanks!