celeborn icon indicating copy to clipboard operation
celeborn copied to clipboard

[CELEBORN-1378] Call PartitionDataWriter#flush() before submitting to commitThreadPool

Open waitinfuture opened this issue 10 months ago • 2 comments

What changes were proposed in this pull request?

There are high commit files latency in some production environments. This PR triggers flush before calling close to avoid waiting in commitThreadPool.

Why are the changes needed?

ditto

Does this PR introduce any user-facing change?

No

How was this patch tested?

Passes GA.

waitinfuture avatar Apr 08 '24 09:04 waitinfuture

cc @RexXiong @FMX @cfmcgrady

waitinfuture avatar Apr 08 '24 09:04 waitinfuture

This PR is stale because it has been open 20 days with no activity. Remove stale label or comment or this will be closed in 10 days.

github-actions[bot] avatar May 15 '24 08:05 github-actions[bot]

This issue was closed because it has been staled for 10 days with no activity.

github-actions[bot] avatar May 26 '24 08:05 github-actions[bot]

This PR is stale because it has been open 20 days with no activity. Remove stale label or comment or this will be closed in 10 days.

github-actions[bot] avatar Jul 24 '24 08:07 github-actions[bot]

This issue was closed because it has been staled for 10 days with no activity.

github-actions[bot] avatar Aug 04 '24 08:08 github-actions[bot]