2D-VQ-AE-2 icon indicating copy to clipboard operation
2D-VQ-AE-2 copied to clipboard

Published 20 hours ago • verified publisher icon sara-nl

Find out how to add pruner through hydra config

Open robogast opened this issue 2 years ago • 1 comments

Pruners are not currently supported through the hydra optuna sweeper plugin: https://github.com/facebookresearch/hydra/issues/1710 .

Adding the pruner to the sweeper ourselves might be doable, as it seems like a single argument added to https://github.com/facebookresearch/hydra/blob/30a8c8a070166ac2d3b19c4ca29af7aa500dc269/plugins/hydra_optuna_sweeper/hydra_plugins/hydra_optuna_sweeper/_impl.py#L183 .

Tasks:

  • [x] create fork of hydra: https://github.com/sara-nl/hydra/tree/optuna-pruner
  • [x] add pruner to OptunaSweeperConf: https://github.com/facebookresearch/hydra/blob/main/plugins/hydra_optuna_sweeper/hydra_plugins/hydra_optuna_sweeper/config.py#L133
  • [x] add pruner to study: https://github.com/facebookresearch/hydra/blob/30a8c8a070166ac2d3b19c4ca29af7aa500dc269/plugins/hydra_optuna_sweeper/hydra_plugins/hydra_optuna_sweeper/_impl.py#L183 .
  • [x] check functionality with submitit launcher
    • Fixed in hydra optuna implementation

robogast avatar Sep 24 '21 09:09 robogast