quickwit icon indicating copy to clipboard operation
quickwit copied to clipboard

Implement an IndexManagementService to centralize CRUD operations on indexes

Open fmassot opened this issue 3 years ago • 0 comments

Notes

  • Add the IndexManagementService in quickwit-index-management new project.
  • Implement the gRPC client so that other nodes can make gRPC calls for CRUD index operations.
  • Move the garbage collect to the IndexManagementService
  • Add garbage collection of local splits (IndexingSplitStore).
  • Start the service on the ControlPlane node.
  • (optional) Add REST API available on the Control Plane only.
  • Update the CLI to use the gRPC client or REST API.

Related issues

  • When starting a node, make sure there is a control plane node available
  • If the control plane node shuts down, indexing pipelines should not restart indefinitely
  • Make sure there is only one Control Plane in the cluster.

fmassot avatar Jul 25 '22 12:07 fmassot