kubeless icon indicating copy to clipboard operation
kubeless copied to clipboard

Workflow management mechanism in Kubeless

Open arjunrao87 opened this issue 6 years ago • 6 comments

This is less of an issue and more of an improvement proposal. Currently we use event chaining to create workflows, but as the serverless functions become more complex and numerous, maintaining the workflow graph will become more complicated.

Since other serverless function frameworks are coming up with workflow management mechanisms I just wanted to start a conversation around something like this for kubeless.

Some examples of existing workflow creation/management tools are

  • Azure : Logic Apps ( https://azure.microsoft.com/en-us/services/logic-apps/ )
  • AWS : Step Functions ( https://aws.amazon.com/step-functions/ )
  • Fission : Workflows ( https://techcrunch.com/2017/10/03/platform9s-fission-workflows-makes-it-easier-to-write-complex-serverless-applications/ )

arjunrao87 avatar Oct 03 '17 21:10 arjunrao87

Hi @arjunrao87,

thanks for the proposal, it is indeed a interesting feature. We will take it into account for next iterations. In order to achieve something like that we would need to refactor how we handle triggers, being able to use them under a certain logic. Stay tuned for updates :)

andresmgot avatar Oct 04 '17 16:10 andresmgot

Link related issues together #88

ngtuna avatar Oct 10 '17 09:10 ngtuna

Edit: What do you think about a Dag workflow like https://github.com/argoproj/argo? /cc @jessesuen

bhack avatar Jul 09 '18 17:07 bhack

maybe: https://airflow.apache.org/

sebgoa avatar Jul 10 '18 08:07 sebgoa

Anyone taking a look into this? I was wondering about https://nodered.org/ also, i guess the one that has the most friendly SDK integration approach would be the best candidate.

vniche avatar Dec 03 '19 16:12 vniche

Any chance to make the workflow compatible with serverless-step-functions ?

junjie-landing avatar Jun 21 '21 00:06 junjie-landing