How does this compare to other DAG solutions?
For example how is it same or different from Airflow or Prefect?
Hey @darwinyip
Xene is under active development and currently lacks a lot of features when compared to full-fledged solutions like Airflow, Perfect, Argo, or Temporal. This includes features like
- Data pipelines with IO components using connectors in Xene.
- Custom steps like- artifact pull, image build, etc.
- Dynamically versioned workflow
- Workflow orchestration using code etc.
I am currently also working on a workflow benchmark using Argo, Airflow, and Xene. Feel free to watch the repository if you want to get notified. I will also try to compare these solutions feature-wise in the same project.
Rather than feature comparison, talk about what distinguishes yours from the rest. Maybe there is something you don't like about current solutions that you are trying to address.
Yeah, I think this makes more sense. I am currently working on the design docs of Xene(https://github.com/fristonio/xene/tree/master/docs/design) and will try to incorporate information about architectural/behavioral decisions and differences from other solutions that went into xene there.