Hydra outputs moved to checkpoints/experiment_name dir

[danbochman]

Change behaviour of Hydra to output logs to user's checkpoints/experiment_name directory Current behaviour spams output directories with unique timestamps for every run

This solves the bug where datasets such as cifar10, mnist, etc. were downloaded and extracted from scratch in each run. In addition, this allows for easy loading of trained model, since now checkpoints are stored together with the YAML config that created them. A simple script can rebuild the model and load the weighs to it.

• flake8 cleanup
• environment_config.py: line 6 added package checkpoints dir as environment variable
• env_helpers.py: line 60 added argument for Hydra output dir init
• checkpoint_utils: line 51 used global PKG_CHECKPOINTS_DIR since it already exists

I recommend removing support for "external_checkpoint_path"; users can create symbolic links instead for now

[dagshub[bot]]

Join the discussion on DagsHub!

[shaydeci]

Closing this down as another PR with the same purpose has been opened.

[shaydeci]

https://github.com/Deci-AI/super-gradients/pull/323