labixiaoK
labixiaoK
> According to the original word2vec paper (https://arxiv.org/pdf/1310.4546.pdf), Negative sampling loss is implemented as: >  > > Your implementation for the sum log sample is: > > ```python >...
> @labixiaoK hi, I can confirm that the author's code is right. He has a line accounting for the negative samples that I did not notice. > > ```python >...
1. eval_dataset.map 时候: 将 preprocess_function_eval 更改为 preprocess_function_train 2. do_eval 时候 :改为 metrics = trainer.evaluate(metric_key_prefix="eval") 3. 启动脚本时候,确保 predict_with_generate 为 False 就可以了