trl icon indicating copy to clipboard operation
trl copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Fix `start` index under `batched_forward_pass`

Open mertsayar8 opened this issue 8 months ago • 2 comments

Start index under batched_forward_pass starts from the last query token which does not align with the comment in line 1032. This also causes a problem when handling the response tokens as stated in #1781.

Set start to the first response token instead of the last query token.

mertsayar8 avatar Jun 27 '24 12:06 mertsayar8