CompareNet_FakeNewsDetection

CompareNet_FakeNewsDetection copied to clipboard

Hi, thanks for sharing the code. when I run the test command "python main.py --mode 1 --model_file MODELNAME" it has an error as below, I am wondering if you could help me please? Much appreciated

It worked for me by giving MODELNAME only instead of ckpt/MODELNAME

It worked for me by giving MODELNAME only instead of ckpt/MODELNAME

Thank you, may I ask if you just use the test command "python main.py --mode 1 --model_file MODELNAME" or after using the train command "python main.py --mode 0"?

Additionally, I get the result as and it seems different from the result shows in table 2, I am wondering if you have the same issue?

Thanks a lot

Accuracy on the OOD test set 2: 0.6932 Precision on the OOD test set 2 macro / micro: 0.7136, 0.6932 Recall on the OOD test set 2 macro / micro: 0.6932, 0.6932 F1 on the OOD test set 2 macro / micro: 0.6883, 0.6932 Latex: 69.32 & 71.36 & 69.32 & 68.83

Accuracy on the OOD test set 2: 0.9165 Precision on the OOD test set 2 macro / micro: 0.9182, 0.9165 Recall on the OOD test set 2 macro / micro: 0.9168, 0.9165 F1 on the OOD test set 2 macro / micro: 0.9165, 0.9165 Latex: 91.65 & 91.82 & 91.68 & 91.65

This is my result and I think minor difference is acceptable.