DyHATR icon indicating copy to clipboard operation
DyHATR copied to clipboard

Inconsistent Performance on Ecomm

Open wondergo2017 opened this issue 4 years ago • 0 comments

I run your code 3 times without any change. And I get output:

AUROC: 0.6687(0.0038), AUPRC: 0.6664(0.0069) AUROC: 0.6630(0.0029), AUPRC: 0.6617(0.0044) AUROC: 0.6682(0.0063), AUPRC: 0.6638(0.0046)

which is significantly lower than results reported in your paper (https://arxiv.org/abs/2004.01024) :

DyHATR-TGRU: 0.690(0.004) , 0.738 (0.007) DyHATR-TLSTM: 0.696(0.005), 0.734 (0.005)

I run the codes in the environment with exact package version you mention in the readme.

Is this code or paper the final version? Or should I change the default hyperparameters in your codes ?

Wish for your reply, it'd be of great help.

wondergo2017 avatar Jan 18 '22 10:01 wondergo2017