flink-remote-shuffle icon indicating copy to clipboard operation
flink-remote-shuffle copied to clipboard

Published 20 hours ago • verified publisher icon flink-extended

Introduce rest APIs for dynamic disk online/offline

Open wsry opened this issue 3 years ago • 0 comments

Motivation

Based on the rest API, we can remove or add disk dynamically without restarting the cluster. For example, we can remove a bad disk or we can add more new disks.

Changes

New rest APIs need to be added together with the corresponding handler. In the handler, disks are removed from or added to the disk list. Both removing one disk from all ShuffleWorkers or removing one disk of a specific ShuffleWorker should be supported.

Test

  • Unit test.
  • Test manually on a cluster.

wsry avatar Dec 06 '21 08:12 wsry