trl icon indicating copy to clipboard operation
trl copied to clipboard

passing attention mask to PPOTrainer

Open HassanJbara opened this issue 1 year ago • 2 comments

Is there a way to pass attention masks of tokenized queries to the PPOTrainer or the generate() function? I see that other classes in the library have padding data collators, where attention masks could be included in the dataset, but not this one.

HassanJbara avatar Feb 28 '24 20:02 HassanJbara