Ethan Feng

[CELEBORN-914] Support memory file storage

2

### What changes were proposed in this pull request? To support memory file storage. ### Why are the changes needed? To improve shuffle performance for small shuffle files. Design doc:...

[CELEBORN-1545] Add Tez plugin skeleton and dag app master

1

### What changes were proposed in this pull request? Add tez plugin skeleton ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? NO. ### How...

### What changes were proposed in this pull request? Add a Tez patch to support customizing the main class. ### Why are the changes needed? ### Does this PR introduce...

[CELEBORN-1497] Optimize read buffer dispatcher to retain buffers until worker has memory pressure

2

### What changes were proposed in this pull request? To improve read buffer dispatcher performance. ### Why are the changes needed? In map partition scenario, there can be lots of...

[CELEBORN-1601] Support revise lost shuffles

4

### What changes were proposed in this pull request? To support revising lost shuffle IDs in a long-running job such as flink batch jobs. ### Why are the changes needed?...

### What changes were proposed in this pull request? Change partition manager relocates partition locations will respect the value of `celeborn.storage.availableTypes`. ### Why are the changes needed? In the current...