flink-on-k8s-operator icon indicating copy to clipboard operation
flink-on-k8s-operator copied to clipboard

Published 20 hours ago • verified publisher icon spotify

Allow JM to have more than 1 replicas

Open jto opened this issue 2 years ago • 4 comments

In a HA setup, one may want to have more than 1 JM replica. fixes #256

jto avatar Jun 02 '22 14:06 jto

@martinbomio I'll need to test it on our dev cluster.

jto avatar Jun 02 '22 15:06 jto

Thinking about it I think the service will load balance between the JMs which is probably a terrible thing to do. Maybe HA should be supported by the operator directly (as in high-availability: true) and not something you set up "manually". At the same time, if you explicitly ask for the JM to have more than 1 replica, maybe you know what you're doing.

@regadas wdyt ?

jto avatar Jun 02 '22 15:06 jto

Hm, right... maybe we could just add the required props for HA automatically when setting replicas >1? keeping the default value as 1 and then be clear of the behavior in docs. wdyt?

regadas avatar Jun 03 '22 06:06 regadas

@regadas Yep that's what I was thinking too.

jto avatar Jun 03 '22 08:06 jto

@jto @regadas do we have an issue to track this festure request? If we don't, I can create one given this is still relevant

martinbomio avatar Feb 15 '23 00:02 martinbomio

I think this one is a bit related https://github.com/spotify/flink-on-k8s-operator/issues/256. But feel free to open a new one if you feel it doesn't capture it all.

regadas avatar Feb 15 '23 07:02 regadas