disco
disco copied to clipboard
Add hyper-parameter search on the server
Suggested by @Saipraneet on FeAI
Can we add some functionality at the server level to do hyper-parameter search as well? This I think is quite useful and necessary.
Essentially, the server can start training with different hyperparameters on different clients, and keep track of this. We can use this to for e.g. figure out what learning rate to use etc.