xene icon indicating copy to clipboard operation
xene copied to clipboard

How does this compare to other DAG solutions?

Open darwinyip opened this issue 5 years ago • 3 comments

For example how is it same or different from Airflow or Prefect?

darwinyip avatar Jun 24 '20 13:06 darwinyip

Hey @darwinyip

Xene is under active development and currently lacks a lot of features when compared to full-fledged solutions like Airflow, Perfect, Argo, or Temporal. This includes features like

  • Data pipelines with IO components using connectors in Xene.
  • Custom steps like- artifact pull, image build, etc.
  • Dynamically versioned workflow
  • Workflow orchestration using code etc.

I am currently also working on a workflow benchmark using Argo, Airflow, and Xene. Feel free to watch the repository if you want to get notified. I will also try to compare these solutions feature-wise in the same project.

fristonio avatar Jun 24 '20 14:06 fristonio

Rather than feature comparison, talk about what distinguishes yours from the rest. Maybe there is something you don't like about current solutions that you are trying to address.

darwinyip avatar Jun 24 '20 16:06 darwinyip

Yeah, I think this makes more sense. I am currently working on the design docs of Xene(https://github.com/fristonio/xene/tree/master/docs/design) and will try to incorporate information about architectural/behavioral decisions and differences from other solutions that went into xene there.

fristonio avatar Jun 24 '20 16:06 fristonio