LLaVA icon indicating copy to clipboard operation
LLaVA copied to clipboard

[Question] Why training with answer?

Open XipengY opened this issue 1 year ago • 0 comments

Question

We print the input_ids and labels before calculate losses, and we found that the input_ids with answer same as labels, it means that the answer would be predicted are in input_ids to the LLaMA, please kindly correct me if I am wrong.

image

image

XipengY avatar May 18 '23 02:05 XipengY