newsreclib icon indicating copy to clipboard operation
newsreclib copied to clipboard

Why the performance is very different to other paper?

Open chiyuzhang94 opened this issue 8 months ago • 2 comments

Hi Andreea,

I notice that the model performance reported in your paper is very different to the performance in original paper. For example, MINER (Li et al. 2019) got AUC=69.61 on MIND-small dataset but your reported performance is only AUC=51.2. Compared to other work reproduced MINER model, this performance is much lower than others. For example, this paper reported that their reproduced MINER model got AUC of 63.88. In general, most GeneralRec models in your Table 1 got AUC < 52.00, which are largely different to the performance reported in other papers. Could you give any comments on this?

chiyuzhang94 avatar Dec 20 '23 05:12 chiyuzhang94