Yuxin Tan
Yuxin Tan
## What is the purpose of the change This change introduces the `ReducePartition` shuffle mode for remote shuffle service. `ReducePartition` is a good supplement to the current `MapPartition`. It has...
## What is the purpose of the change SortBuffer can improve read performance significantly, but it doesn't support read data from a specific channel. The development of some new functions,...
### Motivation SortBuffer can improve read performance significantly, but it doesn't support read data from a specific channel. The development of some new functions, for example, ReducePartition implementation, depends on...
### Motivation Currently, the high availability of ShuffleManager depends on the support of external services when it hangs up. In essence, ShuffleManager has a single point problem. We can introduce...
This is an umbrella of some further improvements for remote shuffle service. ### Tasks - [x] https://github.com/flink-extended/flink-remote-shuffle/issues/79 - [x] https://github.com/flink-extended/flink-remote-shuffle/issues/81
### Motivation As Flink 1.16 is going to release, the remote shuffle project should also adapt to 1.16. ### Changes - Adapt to Flink 1.16 which means adapting to some...
## What is the purpose of the change *The AvailabilityNotifierImpl in SingleInputGate has maps storing the channel ids. But the map key is the result partition id, which will change...