ray_lightning icon indicating copy to clipboard operation
ray_lightning copied to clipboard

Published 20 hours ago • verified publisher icon ray-project

ElasticRayExecutor

Open igorgad opened this issue 3 years ago • 2 comments

Hi, any plan to support Elastic Horovod?

Thanks,.

igorgad avatar Apr 25 '21 17:04 igorgad

Hi @igorgad this could be very interesting. I think we would first want to add an ElasticHorovod plugin in Pytorch Lightning, and then add an ElasticRayHorovod plugin in this library. Do you mind posting an issue on the Pytorch Lightning repo to gauge some more interest for this?

amogkam avatar Apr 29 '21 22:04 amogkam

Interesting. May generic elastic mode could be introduced not only on horovod, also can be applied on elastic pytorch. @igorgad @amogkam

zuston avatar Aug 24 '21 07:08 zuston