domino icon indicating copy to clipboard operation
domino copied to clipboard

Feature - Workflow pieces sharing local network

Open vinicvaz opened this issue 10 months ago • 2 comments

What is the problem this feature will solve?

This discussion brought https://github.com/Tauffer-Consulting/domino/discussions/289#discussion-6555798 an interesting point about network communication between pieces. Imagine a scenario where you want to have an web API piece that listen to other pieces to do actions, currently this is not possible, but maybe we want that.

What is the feature you are proposing to solve the problem?

We should consider a way of creating virtual networks in workflow context so pieces in the same workflow can share information using the localhost network.

What alternatives have you considered?

We should extend DominoK8SOperator and DominoDockerOperator to access k8s and docker api, create the network at the run of the dag and attach to the pieces in the same workflow.

vinicvaz avatar Apr 25 '24 17:04 vinicvaz

@tdari @nathan-vm fyi

vinicvaz avatar Apr 25 '24 17:04 vinicvaz

could we create a base Piece wrapper (e.g. BaseApiPiece) that would handle the rules for security, etc?

luiztauffer avatar Apr 26 '24 08:04 luiztauffer