awd-lstm-lm
awd-lstm-lm copied to clipboard
--cuda and --tied are True by default?
In specifying commandline arguments in main.py
and finetune.py
the --cuda
and --tied
flags are True by default and get False on specifying. Is this intentional? Seems counter-intuitive. Does this have any bearing on the results in your paper Regularizing and Optimizing LSTM Language Models?
https://github.com/salesforce/awd-lstm-lm/blob/bf0742cab41d8bf4cd817acfe7e5e0cbff4131ba/main.py#L45
tagging @Smerity @keskarnitish
Our apologies; we intend for both to be on by default so as to reduce the number of flags passed for each run. We will work on fixing that to make it --no-cuda
and --no-tied
or equivalent to prevent the confusion.