SangBin Cho
SangBin Cho
it is ready for the review
Hmm I actually have 2 suggestions in this case? https://docs.ray.io/en/master/ray-core/handling-dependencies.html -> I saw this doc, and it is not clear to me where to look in order to perform the...
Unstale. We can replace this to https://docs.google.com/document/d/1ngiuAZAMnl9c4LozoTpWh37KPviDRIpmEjEI6BsNL7w/edit# by ray 2.5
cc @RehanSD for the awareness.
Also, I will make sure the replacement API will be available and documented by ray 2.6
note: this is the repro script; https://github.com/ray-project/ray/issues/27499#issuecomment-1260079287
We fixed various issues relevant to process leak. We will try repro with ^ script, and close the issue if it is not happening again.
@LilDojd thanks for the detailed report! > Is this an expected behavior when multiple large DAGs run from the same entry point? IDLE procesess are supposed to exist while you...
Hmm actually having idle processes alive while running a script is not an unexpected behavior (it is intended actually). I think the main question here is 1. how many processes...
> By the way, do you happen to know the impact of this on worker startup time? My impression is that conda activate already takes a couple seconds, and this...