celeborn
celeborn copied to clipboard
[CELEBORN-1361] MaxInFlightPerWorker should use the value provided by PushStrategy
What changes were proposed in this pull request?
The data push thread should first send requests to workers that are not under pressure.
Use PushStrategy's currentMaxReqsInFlight to better filter requests.
Why are the changes needed?
Prevent blocking other requests
Does this PR introduce any user-facing change?
How was this patch tested?
This PR is stale because it has been open 20 days with no activity. Remove stale label or comment or this will be closed in 10 days.
Thanks! Merging to main(v0.5.0)