celeborn
celeborn copied to clipboard
[CELEBORN-1378] Call PartitionDataWriter#flush() before submitting to commitThreadPool
What changes were proposed in this pull request?
There are high commit files latency in some production environments. This PR triggers flush before calling close to avoid waiting in commitThreadPool.
Why are the changes needed?
ditto
Does this PR introduce any user-facing change?
No
How was this patch tested?
Passes GA.
cc @RexXiong @FMX @cfmcgrady
This PR is stale because it has been open 20 days with no activity. Remove stale label or comment or this will be closed in 10 days.
This issue was closed because it has been staled for 10 days with no activity.
This PR is stale because it has been open 20 days with no activity. Remove stale label or comment or this will be closed in 10 days.
This issue was closed because it has been staled for 10 days with no activity.