Ruoyu Zhang

Runtime error in backward

1

你好，在尝试使用这份代码时，我遇到了如下的bug： Traceback (most recent call last): File "run.py", line 64, in trainer.train() File "/home/anaconda3/envs/pytorch/lib/python3.8/site-packages/fastNLP/core/trainer.py", line 622, in train raise e File "/home/anaconda3/envs/pytorch/lib/python3.8/site-packages/fastNLP/core/trainer.py", line 615, in train self._train() File "/home/anaconda3/envs/pytorch/lib/python3.8/site-packages/fastNLP/core/trainer.py", line...

Step 2 reward model finetuning: how is the loss computed?

1

Hi there, I notice that in step 2, the reported scores (i.e. `chosen_mean_scores` and `reject_mean_scores`) are the same as the description: > ... either the end token of the sequence...