quickwit
quickwit copied to clipboard
quickwit-oss
Cloud-native search engine for observability. An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.
## Notes - Add the `IndexManagementService` in `quickwit-index-management` new project. - Implement the gRPC client so that other nodes can make gRPC calls for CRUD index operations. - Move the...
We want to let users define a retention policy associated to an index. The retention policy should periodically delete splits that go out of retention (as part of the GC...
On main branch we have these routes for search and index management: - `/api/v1/{index-id}/search` - `/api/v1/{index-id}/search/stream` - `/api/v1/indexes` - `/api/v1/indexes/{index-id}` - `/api/v1/indexes/{index-id}/splits` I would prefer to have always the prefix...
We want to be able to physically delete documents per query. Concretely it means downloading split, applying the query, uploading the split, updating the metastore. This physical delete can be...
The objective would be to allow having a larger indexing throughput by running K indexing pipelines for a single index. The selector coudl be k % N, or a list...
The current merge policy attempts to merge splits spanning over contiguous window of time, with the same size, in groups of 10, to reach a given target size of 10...
### Description Closes #1761 This PR adds the start of a disk-based LRU cache. And has the following structure and behaviour: - The core disk handling is detached from the...
We have several issues. Right now the search stream logic is needlessly convoluted. Also see #1744 #1745 #1749 #1693. A lot of the logic is redundant. One final key problem...
If num_docs is not required, there are many optimization we can run. For instance, if we sort by docs we can often searhc on only one split and abort search...
Metadata
Owner
Metadata
Cloud-native search engine for observability. An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.