newsreclib
newsreclib copied to clipboard
Why the performance is very different to other paper?
Hi Andreea,
I notice that the model performance reported in your paper is very different to the performance in original paper. For example, MINER (Li et al. 2019) got AUC=69.61 on MIND-small dataset but your reported performance is only AUC=51.2. Compared to other work reproduced MINER model, this performance is much lower than others. For example, this paper reported that their reproduced MINER model got AUC of 63.88. In general, most GeneralRec models in your Table 1 got AUC < 52.00, which are largely different to the performance reported in other papers. Could you give any comments on this?