distributed icon indicating copy to clipboard operation
distributed copied to clipboard

documentation not updated following #3029

Open vianneylanguille opened this issue 2 months ago • 3 comments

Following closure of https://github.com/dask/distributed/issues/1389 after merge allowing work stealing for resources-restricted tasks, it seems doc has not been updated.

https://distributed.dask.org/en/stable/work-stealing.html#restrictions still states:

"If a task has been specifically restricted to run on particular workers (such as is the case when special hardware is required) then we do not steal."

Maybe it would be worth clarifying that resources restrictions are OK.

vianneylanguille avatar Oct 26 '25 14:10 vianneylanguille

@vianneylanguille would you be interested for making a PR for this update?

guillaumeeb avatar Oct 29 '25 16:10 guillaumeeb

@guillaumeeb yes, but actually I am not sure whether my statement is True or not. i can update the doc but I would just need a cross check from someone who knows better the topic than me

vianneylan avatar Oct 30 '25 10:10 vianneylan

Well, code has changed a lot since the first fix for task with resources stealing, but there are steal tests running with worker or resources restrictions: https://github.com/dask/distributed/blob/main/distributed/tests/test_steal.py#L531.

So I guess the statement is indeed False and has been for a while!

guillaumeeb avatar Oct 30 '25 16:10 guillaumeeb