marie-ai
marie-ai copied to clipboard
Implement work scheduling and distribution
Currently basic load balancing is used for work distributions, this needs to be replaces with much more robust solution. In original jina-ai work distribution is done via gRpc, this does work however it has number of limitations, this is where our implementation will differ significantly.
Objectives :
- Predictable workflow (Directed acyclic graph)
- Scheduling and Prioritization
- Resilience to failure
- Reliability