flinkk8soperator
flinkk8soperator copied to clipboard
lyft
Kubernetes operator that provides control plane for managing Apache Flink applications
Is it necessary to use NFS in jobManager and taskManager as both pods tries to mount same volumes?
Hi, We recently faced following issue: We have a working implementation of FlinkApplication, which successfully works when we do not use any volumes and the pods fallback to host volumes....
Occasionally we see task manager JVM process get stuck, with the task manager no longer registered with Flink but the process also not able to exit. This leads to a...
A draft to implement new functionality proposed in #197. Adding in values to the CRD to support conveying that savepoint during upgrade can be performed with a checkpoint instead. Checkpoints...
i have a yaml in k8s like below: > flinkConfig: jobmanager.heap.size: "2g" jobmanager.execution.failover-strategy: region jobmanager.web.log.path: /var/log/jobmanager/current taskmanager.log.path: /var/log/taskmanager/current taskmanager.exit-on-fatal-akka-error: true taskmanager.network.memory.min: 128m taskmanager.network.memory.max: 512m taskmanager.network.memory.fraction: 0.125 taskmanager.maxRegistrationDuration: Inf taskmanager.initial-registration-pause: 500ms...
Our Flink job deploys rely heavily on checkpoints since our savepoints take around 30 -45 minutes to write and read back in on the new job. It appears that enabling...
Thank you for developing and open-sourcing this operator! Maintaining Flink jobs with state on Kubernetes without it has been error prone. Quick question: I'd also like to use this operator...
The [proposal to support Beam Python applications with the Flink k8s operator](https://docs.google.com/document/d/1z3LNrRtr8kkiFHonZ5JJM_L4NWNBBNcqRc_yAf6G0VI/edit#heading=h.lnhm75dhvhi0 ) requires the addition of a sidecar container for the Beam SDK worker pool to the Flink task...
Is there a way to customize the deployment generated by the operator. In particular adding init containers to do setup work required by our environment? We are generating job jars...
https://github.com/lyft/flinkk8soperator/blob/master/examples/beam-python/flink-operator-custom-resource.yaml I did kubectl create -f flink-operator-custom-resource.yaml but on the taskmgr pod log I did not see python example got invoked.
We urgently need the example of beam-java-sdk FlinkRunner running on Flink. our company likes to adopt beam-java-sdk FlinkRunner over Flink on k8s if there is a solution