flink-on-k8s-operator

flink-on-k8s-operator copied to clipboard

FlinkOperator crashes when deploying a new Job in a FlinkCluster

1

I am trying to update a running Job in my Flink Job Cluster. I am using commit which is still in PR with some fixes: https://github.com/GoogleCloudPlatform/flink-on-k8s-operator/pull/401/commits/72e89b2684ada58ec9a4987d49f902841a86607b FlinkOperator triggers the Savepoint...

morelina

Failed to submit JobGraph and the exception detail was not enough to detect the reason

1

With latest master build create example session cluster and job cluster using flink:1.12.1-scala_2.12-java11 In test docker env. ``` /opt/flink/bin/flink run -m flinksessioncluster-sample-jobmanager:8081 /opt/flink/examples/myfault-1.0-SNAPSHOT.jar ``` ``` 2021-02-04 02:31:03,798 INFO org.apache.flink.client.cli.CliFrontend []...

jiamo

Cannot create sample FlinkCluster: "flinkjobcluster-sample" is invalid: [status.components.jobManagerStatefulSet: Required value, status.components.taskManagerStatefulSet: Required value]

7

After installing the operator using `make deploy`, I'm trying to create the sample JobCluster by running: ```bash kubectl apply -f config/samples/flinkoperator_v1beta1_flinkjobcluster.yam ``` The reconciler never succeeds and the following errors...

fabito

Unable to specify securityContext.fsGroup needed for AWS OIDC authentication of the pod

4

Since the flink containers runs as user `flink`, its currently impossible to use EKS serviceAccount/IAM role "binding" directly. The problem is described in this [external-dns PR](https://github.com/kubernetes-sigs/external-dns/pull/1185) Solution is to set...

jalkjaer

Autoscaling enhancement

9

Hi all, I'm interested in autoscaling support for the operator. You can see that [ververica platform](https://www.ververica.com/blog/introducing-ververica-platform-2.2-with-autoscaling-for-apache-flink) supports this now, the mechanism I gather from their post is: 1. Monitor CPU...

Padarn

savepointDir only supported gs://? we want to use s3://

8

how to use s3:// as our savepointDir how to solve the problem

kaohaonan6666

Failed to install flink-operator via Helm to AWS EKS

7

I am trying to install the flink operator to my AWS EKS cluster following the helm instruction: https://github.com/GoogleCloudPlatform/flink-on-k8s-operator/blob/master/helm-chart/flink-operator/README.md. After I run the helm command: **helm install flink-operator flink-operator-repo/flink-operator --set operatorImage.name=gcr.io/flink-operator/flink-operator:latest,**...

yanghui16355

Mount sensitive Flink Properties as Secrets

5

When setting up security for Flink through the Flink Properties as https://github.com/GoogleCloudPlatform/flink-on-k8s-operator/issues/309 describes, the following properties are stored in a ConfigMap and mounted into the JobManager and TaskManager containers: ```...

EnriqueL8

Helm fails with latest operator image while make deploy works

3

Hi, I am tryin to use the latest Flink Operator image and tried to deploy with Helm and Make deploy. Helm fails to deploy while make works with the same...

shravangit20

Multiple JobManager replicas?

3

Hi everyone, have noticed we can have multiple TaskManager replicas, does it make sense to have multiple JM ones? What if I don't want to use something like Zookeeper for...

a-roberts