metaseq icon indicating copy to clipboard operation
metaseq copied to clipboard

Figure out potential duplication in ConfigStore

Open suchenzang opened this issue 2 years ago • 1 comments

By the time we get to our first convert_namespace_to_omegaconf call, we already have:

# from hydra.core.config_store import ConfigStore
(Pdb) cs = ConfigStore.instance()
(Pdb) cs.repo.keys()
dict_keys(['hydra', '_dummy_empty_config_.yaml', 'base_config.yaml', '_name.yaml', 'common.yaml', 'common_eval.yaml', 'distributed_training.yaml', 'dataset.yaml', 'optimization.yaml', 'checkpoint.yaml', 'generation.yaml', 'eval_lm.yaml', 'model.yaml', 'task.yaml', 'criterion.yaml', 'optimizer.yaml', 'lr_scheduler.yaml', 'bpe.yaml', 'tokenizer.yaml', 'model', 'optimizer', 'lr_scheduler', 'bpe', 'task'])

which seems to have some redundancy in yaml vs non-yaml keys. Figure out if we can remove the *.yaml keys somehow.

suchenzang avatar Mar 14 '22 02:03 suchenzang