spring cloud dataflow launch task on other the kubernetes cluster

[azmhyy2021]

trafficstars

Problem description:

I want spring cloud dataflow launch task on the the kubernetes cluster which is not running the spring cloud dataflow server. For example, spring cloud dataflow is running on AWS EKS and the task will be deployed and ran on Google GKE.

I can't find this feature

[cppwfs]

Hello @azmhyy2021 , SCDF supports the ability to launch an app in multiple platforms. Here is the documentation on setting that up: https://dataflow.spring.io/docs/recipes/multi-platform-deployment/multi-platform-task/#launching-tasks-across-multiple-platforms-from-an-external-spring-cloud-data-flow

[ghost]

Hello @azmhyy2021 , SCDF supports the ability to launch an app in multiple platforms. Here is the documentation on setting that up: https://dataflow.spring.io/docs/recipes/multi-platform-deployment/multi-platform-task/#launching-tasks-across-multiple-platforms-from-an-external-spring-cloud-data-flow

In the manual, there is no explaination about how external kubernetes is configured. no address no cluster name....

Could you explain it to me please?

[krugerm-4c]

Also having same issue; the documentation mentions external spring cloud data flow, but doesn't provide an explanation or example configuration how to configure a URL for the Kubernetes API server (and any other required configuration).

[corneil]

This should the configuration for multiple accounts. https://dataflow.spring.io/docs/recipes/multi-platform-deployment/multiple-platform-accounts/#mixing-cloud-foundry-and-kubernetes-deployments.

In this extract the fabric8 property is of type io.fabric8.kubernetes.client.Config

"platform.kubernetes.accounts":  {
  "gpuzone": {
    "fabric8" : {
      "masterUrl" : <k8s-master-api-url>,
      "namespace" : "gpuzone-namespace",
      "trustCerts" : "true"
    }
  }
}