DyHATR
DyHATR copied to clipboard
Inconsistent Performance on Ecomm
I run your code 3 times without any change. And I get output:
AUROC: 0.6687(0.0038), AUPRC: 0.6664(0.0069) AUROC: 0.6630(0.0029), AUPRC: 0.6617(0.0044) AUROC: 0.6682(0.0063), AUPRC: 0.6638(0.0046)
which is significantly lower than results reported in your paper (https://arxiv.org/abs/2004.01024) :
DyHATR-TGRU: 0.690(0.004) , 0.738 (0.007) DyHATR-TLSTM: 0.696(0.005), 0.734 (0.005)
I run the codes in the environment with exact package version you mention in the readme.
Is this code or paper the final version? Or should I change the default hyperparameters in your codes ?
Wish for your reply, it'd be of great help.