Raymond Roestenburg

@SemanticBeeng This was from quite some time ago. It might need some minor changes to work with Cloudflow 2.1.2, feel free to try this out?

This seems similar to allowing for instance azure-blob storage as state backend, is that correct @blublinsky ? Maybe it is now possible since we support flink config in config files?

I agree, would be good to document how to do this.

Changed issue name

The kubectl cloudflow cli creates a configmap from a command line provided file. For instance ```--log4j-config ``` and ```--logback-config ``` This is specified for the entire cloudflow application (to keep...

The operator must then add a volume mount for the configmaps to every pod. And it must somehow set the log4j / logback configuration with -D setting, for Spark, Flink...

For spark, the approach of java opts -D, and configmap, seems to work: https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/issues/395

@franciscolopezsancho yes you can first tackle being able to change logging through the kubectl cloudflow, with deploy and configure command, even if it only supports a subset of streaming engines....

@franciscolopezsancho Re: your question, see what happens if you specify -Dlog4j.configuration log1.properties -Dlog4j.configuration log2.properties to a jvm, does 1 or 2 get applied? If it is 2, we could add...

@andreaTP I think in new cli this is supported. Let's give it a try if it really works.