ray icon indicating copy to clipboard operation
ray copied to clipboard

[Tune] Change self.Config in tune.Trainable object

Open Jiamian-Wang opened this issue 3 years ago • 2 comments

Search before asking

  • [X] I had searched in the issues and found no similar feature requirement.

Description

Hi, I'm using the scheuler population based trining (PBT). Currently, for each agent, the hyperparameters can be modified through exploit/explore process. While they are kept unchanged within in the Trainable class (i.e., learning rate remains the same during training iterations while might be changed only after exploit/explore). How we can optimize the hyperparameters (i.e., in bi-level optimization case) within the Trainable class and update the self.config accordingly? So that the optimized hyperprameter values appear when we recall Trainable class. Currently I update the self.config but it seems not work......

Use case

No response

Related issues

No response

Are you willing to submit a PR?

  • [x] Yes I am willing to submit a PR!

Jiamian-Wang avatar Dec 16 '21 01:12 Jiamian-Wang

Hey @Jiamian-Wang! Do you mind giving an example of what you are trying to do? Do you want to be able to change the hyperparameters for PBT from within the Trainable?

amogkam avatar Apr 11 '22 18:04 amogkam

Hi, I'm a bot from the Ray team :)

To help human contributors to focus on more relevant issues, I will automatically add the stale label to issues that have had no activity for more than 4 months.

If there is no further activity in the 14 days, the issue will be closed!

  • If you'd like to keep the issue open, just leave any comment, and the stale label will be removed!
  • If you'd like to get more attention to the issue, please tag one of Ray's contributors.

You can always ask for help on our discussion forum or Ray's public slack channel.

stale[bot] avatar Aug 10 '22 03:08 stale[bot]

Hi again! The issue will be closed because there has been no more activity in the 14 days since the last message.

Please feel free to reopen or open a new issue if you'd still like it to be addressed.

Again, you can always ask for help on our discussion forum or Ray's public slack channel.

Thanks again for opening the issue!

stale[bot] avatar Sep 20 '22 18:09 stale[bot]