mTAN icon indicating copy to clipboard operation
mTAN copied to clipboard

Results are not reproducible at all

Open CubicQubit opened this issue 3 years ago • 2 comments

I was able able to run the code perfectly but the hyperparameters given for mTAN-full do not achieve 0.858 AUROC on physionet2012. The highest is AUROC ~0.827 with AUPRC ~0.45.

This is achieved with this command: python3 tan_classification.py --alpha 100 --niters 300 --lr 0.0001 --batch-size 50 --rec-hidden 256 --gen-hidden 50 --latent-dim 20 --enc mtan_rnn --dec mtan_rnn --n 8000 --quantization 0.016 --save 1 --classif --norm --kl --learn-emb --k-iwae 1 --dataset physionet

CubicQubit avatar Nov 16 '21 20:11 CubicQubit

Could you please post the training logs here?

satyanshukla avatar Nov 18 '21 01:11 satyanshukla

Could you please post the training logs here?

I also encounter the question. I've attached the training log below. mtan.log

I am looking forward to hearing back from you.

CodeNinjaja avatar Jun 06 '24 03:06 CodeNinjaja