Optimus icon indicating copy to clipboard operation
Optimus copied to clipboard

Missing requirements file

Open ghazi-f opened this issue 2 years ago • 1 comments

Thank your for sharing this great work !

I have been trying some of your checkpoints but they don't even seem to perform reconstruction right (even at beta=0). Then I tried performing interpolation between a sentence and the same sentence with 10 steps (which should give 10 times the same sentence). But it yields differents sentences.

I suspect this is because of a difference in the version of the python libraries we use (since I didn't modify anything in your scripts). Could you please provide a requirements.txt file with the exact version of the libraries you used ? Thanks a lot !

ghazi-f avatar Dec 15 '21 21:12 ghazi-f

I found the problem with interpolation: interpolating between a sentence and itself gave different sentences because of the random sampling. I set top_k to 1 and top_p to 0.0 and it gave the same sentence for the 10 steps of interpolation. However, reconstruction is still fairly far off from the original sentence even with the beta=0 model checkpoint. Actually it is the same reconstruction with the 3 checkpoints (beta=0, beta=0.5, and beta=1.0). I'm using the wikipedia pretrained models. Is this normal ?

ghazi-f avatar Dec 16 '21 18:12 ghazi-f