Optimus
Optimus copied to clipboard
Missing requirements file
Thank your for sharing this great work !
I have been trying some of your checkpoints but they don't even seem to perform reconstruction right (even at beta=0). Then I tried performing interpolation between a sentence and the same sentence with 10 steps (which should give 10 times the same sentence). But it yields differents sentences.
I suspect this is because of a difference in the version of the python libraries we use (since I didn't modify anything in your scripts). Could you please provide a requirements.txt file with the exact version of the libraries you used ? Thanks a lot !
I found the problem with interpolation: interpolating between a sentence and itself gave different sentences because of the random sampling. I set top_k to 1 and top_p to 0.0 and it gave the same sentence for the 10 steps of interpolation. However, reconstruction is still fairly far off from the original sentence even with the beta=0 model checkpoint. Actually it is the same reconstruction with the 3 checkpoints (beta=0, beta=0.5, and beta=1.0). I'm using the wikipedia pretrained models. Is this normal ?