alignment-handbook icon indicating copy to clipboard operation
alignment-handbook copied to clipboard

How to select parts to bp in sft

Open Fu-Dayuan opened this issue 11 months ago • 0 comments

image As the pic has shown, there are some cases that some parts of the gpt's response should not be cacluated in backward computing, if I want to achieve this function, what should I do? (or can you realize this in a new version?)

Fu-Dayuan avatar Mar 19 '24 10:03 Fu-Dayuan