redpanda icon indicating copy to clipboard operation
redpanda copied to clipboard

Automatic data rebalancing

Open rkruze opened this issue 3 years ago • 2 comments

When a user adds a node or deletes a topic, data should be automatically rebalanced across the cluster.

rkruze avatar Mar 26 '21 20:03 rkruze

Per our discussion this is aimed for 22.1.1 -- @dotnwat @dswang looks like 22.1.1 milestone is empty so feel free to assign to which Q1FY23 category makes sense

vsaraswat avatar Feb 10 '22 17:02 vsaraswat

It might be worth doing periodic balancing at some interval in addition to the above cases.

For example in this instance rebalancing could be helpful because the orange node has more disk usage than the dark blue node. In this instance orange is also receiving more bytes/second than blue. image image

It would also be helpful if there were a REST endpoint (and/or rpk command) to trigger a rebalance manually.

scallister avatar Feb 15 '22 02:02 scallister

@ztlpn is on the case!

dotnwat avatar Apr 16 '24 03:04 dotnwat