awd-lstm-lm icon indicating copy to clipboard operation
awd-lstm-lm copied to clipboard

--cuda and --tied are True by default?

Open sanyam5 opened this issue 7 years ago • 2 comments

In specifying commandline arguments in main.py and finetune.py the --cuda and --tied flags are True by default and get False on specifying. Is this intentional? Seems counter-intuitive. Does this have any bearing on the results in your paper Regularizing and Optimizing LSTM Language Models?

https://github.com/salesforce/awd-lstm-lm/blob/bf0742cab41d8bf4cd817acfe7e5e0cbff4131ba/main.py#L45

sanyam5 avatar Feb 19 '18 09:02 sanyam5

tagging @Smerity @keskarnitish

sanyam5 avatar Feb 24 '18 15:02 sanyam5

Our apologies; we intend for both to be on by default so as to reduce the number of flags passed for each run. We will work on fixing that to make it --no-cuda and --no-tied or equivalent to prevent the confusion.

keskarnitish avatar Feb 28 '18 09:02 keskarnitish