NRI
NRI copied to clipboard
How to reproduce some paper results
Hi, thanks for the the code release.
To make sure that I am running the code properly, I am trying to reproduce some of the paper results. What's the correspondence between the results returned by the code and those reported in the paper? My understanding is as follows:
- The values reported in Table 1 of the paper should be similar to
np.mean(acc_test)
. - The values reported in Table 2 of the paper correspond to what in the code is called "mse". More precisely, in the code there are two similar variables referring to "mse" for test:
mse_test
andmean_mse
. My understanding is thatnp.mean(mse_test)
should be similar to the first column of Table 2 (because a prediction step of 1 is being used, see line 323 of train.py), andnp.mean(mean_mse)
should be similar to the third column of Table 2 (because a prediction step of 20 is being used, see line 351 of train.py).
Is this correct? Thank you!