celeborn icon indicating copy to clipboard operation
celeborn copied to clipboard

[CELEBORN-1497] Optimize read buffer dispatcher to retain buffers until worker has memory pressure

Open FMX opened this issue 1 year ago • 2 comments

What changes were proposed in this pull request?

To improve read buffer dispatcher performance.

Why are the changes needed?

In map partition scenario, there can be lots of buffer requests which performance issue in allocateing memory.

Does this PR introduce any user-facing change?

NO.

How was this patch tested?

GA and Cluster Test.

FMX avatar Jul 11 '24 02:07 FMX

This PR is stale because it has been open 20 days with no activity. Remove stale label or comment or this will be closed in 10 days.

github-actions[bot] avatar Jul 31 '24 09:07 github-actions[bot]

This issue was closed because it has been staled for 10 days with no activity.

github-actions[bot] avatar Aug 11 '24 08:08 github-actions[bot]

This PR is stale because it has been open 20 days with no activity. Remove stale label or comment or this will be closed in 10 days.

github-actions[bot] avatar Oct 15 '24 08:10 github-actions[bot]

This issue was closed because it has been staled for 10 days with no activity.

github-actions[bot] avatar Oct 26 '24 08:10 github-actions[bot]