metaseq
metaseq copied to clipboard
Make it easy to configure non-model-parallel path & have consistent results
In other words, if https://github.com/facebookresearch/metaseq/blob/133d32c04975f94318b6281b3618c9aebf6e8100/metaseq/launcher/opt_job_constants.py#L18 is set to 1, make sure all flags are consistent.
Initialization should be matching too (currently might not be the case).