pinot icon indicating copy to clipboard operation
pinot copied to clipboard

Allow tagging pool to server when server start

Open YujiaZhangRH opened this issue 1 year ago • 1 comments

What needs to be done? We are seeking a method to tag a Pinot server with a specific pool for pool-based instance assignment during server startup.

Why is this feature needed? We are running Pinot on Kubernetes and need to dynamically scale Pinot servers up and down. Currently, when new servers are added to the cluster, the pool tag must be assigned manually to each server. We are looking for a way to specify the pool as part of the StartServer command, automating the process.

Initial idea A possible solution could be to add a new configuration value in CommonConstants, such as "pinot.server.instance.pool". Then, we would update BaseServerStarter to include the pool tag in the znRecord by adding it as a map field.

YujiaZhangRH avatar Oct 03 '24 21:10 YujiaZhangRH

added this to [parent issue] Kubernetes related topics #14162

hpvd avatar Oct 05 '24 10:10 hpvd