NRI icon indicating copy to clipboard operation
NRI copied to clipboard

How to reproduce some paper results

Open pablomorales92 opened this issue 4 years ago • 0 comments

Hi, thanks for the the code release.

To make sure that I am running the code properly, I am trying to reproduce some of the paper results. What's the correspondence between the results returned by the code and those reported in the paper? My understanding is as follows:

  • The values reported in Table 1 of the paper should be similar to np.mean(acc_test).
  • The values reported in Table 2 of the paper correspond to what in the code is called "mse". More precisely, in the code there are two similar variables referring to "mse" for test: mse_test and mean_mse. My understanding is that np.mean(mse_test) should be similar to the first column of Table 2 (because a prediction step of 1 is being used, see line 323 of train.py), and np.mean(mean_mse) should be similar to the third column of Table 2 (because a prediction step of 20 is being used, see line 351 of train.py).

Is this correct? Thank you!

pablomorales92 avatar Nov 04 '20 13:11 pablomorales92