Zhakshylyk Nurlanov

icon indicating a website link https://nurlanov.me/ icon indicating an email [email protected]

icon company University of Bonn icon location Goettingen, Germany icon location Ph.D. student at University of Bonn and Bosch Center for AI. Interested in building reliable deep models

Results 3 comments of Zhakshylyk Nurlanov

Resume multi-run

@tesfaldet thanks for the links! I will take a look

Multiple parallel runs on multi-GPU for hyperparameter search

Thanks @ashleve for the suggestions. So far I managed to launch multi-GPU jobs in parallel using the combination of Ray launcher and Optuna sweeper. I configured Ray as in https://github.com/facebookresearch/hydra/issues/1974#issuecomment-1226185827...

Multiple parallel runs on multi-GPU for hyperparameter search

The jobs wait for all jobs in a previous launch to finish. E.g. if there were 2 parallel runs and one of them quickly failed, it will be waiting for...