Implement an IndexManagementService to centralize CRUD operations on indexes
Open
fmassot
opened this issue 3 years ago
•
0 comments
Notes
- Add the
IndexManagementService in quickwit-index-management new project.
- Implement the gRPC client so that other nodes can make gRPC calls for CRUD index operations.
- Move the garbage collect to the
IndexManagementService
- Add garbage collection of local splits (
IndexingSplitStore).
- Start the service on the
ControlPlane node.
- (optional) Add REST API available on the Control Plane only.
- Update the CLI to use the gRPC client or REST API.
Related issues
- When starting a node, make sure there is a control plane node available
- If the control plane node shuts down, indexing pipelines should not restart indefinitely
- Make sure there is only one Control Plane in the cluster.