quickwit

quickwit copied to clipboard

I've noticed this pattern a few times in the codebase: ```rust metastore.list_all_splits().iter().find() ``` In the short-term, we could expose a new `find_split(index_id, split_id) -> Option` metatore API. In the long-term,...

guilload

Indexer consumption Kafka error

19

**Describe the bug** I started 10 indexer nodes to consume Kafka data and reported the following error: ``` 2022-05-27T06:28:14.854Z INFO {actor=quickwit_indexing::actors::indexing_server::IndexingServer}:{msg_id=1}::{msg_id=418922}:{index=clickhouse gen=319}:{actor=Packager}: quickwit_actors::sync_actor: actor-exit actor_id=Packager-nameless-H4KW exit_status=Killed 2022-05-27T06:28:15.217Z ERROR {actor=quickwit_indexing::actors::indexing_server::IndexingServer}:{msg_id=1}::{msg_id=419295}: quickwit_actors::actor_handle:...

gnufree

- [ ] Design endpoints - [ ] Implement - [ ] Update docs

guilload

Follow search performance on basic queries

3

We could use a restricted set of queries used in tantivy benchmark. Would be also interesting to know the perf with parallel queries.

fmassot

Create a reproducible benchmark to track and investigate index size for different datasets

1

fulmicoton

We should run one GC actor per index, not per source.

2

We run one GC per source, but should run one GC per index ``` 9876568054679316988002] shardId-000000000007:(..49630019518881077165006813008667182781726868974027669618]) checkpoint=Ckpt() 2022-05-31T09:20:38.735Z INFO {actor=quickwit_indexing::actors::indexing_service::IndexingService}:{msg_id=1}::{index=gh-archive gen=0}:{actor=GarbageCollector}:{msg_id=1900}: quickwit_indexing::actors::garbage_collector: garbage-collect-operation 2022-05-31T09:20:38.735Z INFO {actor=quickwit_indexing::actors::indexing_service::IndexingService}:{msg_id=1}::{index=gh-archive gen=0}:{actor=GarbageCollector}:{msg_id=1900}: quickwit_indexing::actors::garbage_collector: garbage-collect-operation 2022-05-31T09:21:38.737Z...

fulmicoton

Working on the UI or something related to it requires building the UI with the latest JS/TS code. ## Problem 1 With the current setup, the following annoying scenario can...

fmassot

Following #1614 opened by @mr-karan, it would be nicer to have a quickstart with an index with a timestamp field in the quickstart. Let's do it!

fmassot

Log tokenizer

2

### Description This pull request is just a draft in order to discuss the suggested fix for issue #1143. ### How was this PR tested? cargo check and cargo test...

nigel-andrews

And the log is not very helpful `Command failed: Index `gh-archive` does not exist.`

fmassot