mTAN icon indicating copy to clipboard operation
mTAN copied to clipboard

Not able to reproduce results for Physionet dataset

Open yalavarthivk opened this issue 3 years ago • 1 comments

Hi,

I have downloaded the code from the git repository and ran the mTAN classifier full on my local machine with the same hyperparameters mentioned. My results do not match with the published ones. In the paper, the mean ROC is 0.858 while I get 0.830.

I could not install torch==1.4.0, hence used torch---1.9. I am attaching the result for your reference. physionet-cnn-0-569442.log

yalavarthivk avatar Nov 12 '21 22:11 yalavarthivk

I'm looking into the logs and checking the code, would be updating the code shortly to get the 0.858 ROC.

satyanshukla avatar Nov 18 '21 02:11 satyanshukla