alignment-handbook
alignment-handbook copied to clipboard
How to select parts to bp in sft
As the pic has shown, there are some cases that some parts of the gpt's response should not be cacluated in backward computing, if I want to achieve this function, what should I do? (or can you realize this in a new version?)