PSeitz
PSeitz
`OptionalIndex::SparseBlock::rank_if_exists::binary_search` is dominating the profile of the aggregation query with 86% The performance on 10M elements is still not terrible performance wise with 140ms. ### Potential Improvements - Lower the...
Date histogram aggregation has been added in https://github.com/quickwit-oss/tantivy/pull/1900 with some limitations: only fixed_interval is supported, calendar-aware features like calendar_interval are not supported format is unsupported. Fixed to Rfc3339 currently. bounds...
Check that all aggs can handle arbitrary data without panicing (it's really hard to test aggs on random data without reimplementing aggs) That arbitrary data should include empty segments, empty...
In some cases for bucket aggregations it's better to delay computation of sub aggregations, until after pruning. There could be a caching layer, that collects the docs for each bucket...
I typically use use the extension to jump directly to docs of a crate. `rs tantivy` jumps to tantivy docs, but `rs ahash` jumps to https://doc.rust-lang.org/std/hash/index.html There's no ahash on...
`extract_typed_sort_value_opt` is in the collect hot loop and very performance sensitive. Delay conversion from u64 to actual type to harvest phase. The impact on the histogram query time seems a...
```rust SortByComponent::FastField { field_name, .. } => { let sort_column_opt: Option = segment_reader.fast_fields().u64_lenient(field_name)?; //
``` failures: tests::index_tests::test_ingest_v2_happy_path test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 8 filtered out; finished in 0.17s --- TRY 2 STDERR: quickwit-integration-tests tests::index_tests::test_ingest_v2_happy_path --- thread 'tests::index_tests::test_ingest_v2_happy_path' panicked...
``` test actors::indexing_pipeline::tests::test_indexing_pipeline_retry_0 ... FAILED test actors::indexing_pipeline::tests::test_indexing_pipeline_simple ... FAILED test actors::indexing_pipeline::tests::test_indexing_pipeline_all_failures_handling ... FAILED test merge_policy::stable_log_merge_policy::tests::test_proptest_simulate_stable_log_merge_planner_adversarial ... ok failures: ---- actors::indexer::tests::test_indexer_triggers_commit_on_drained_mailbox stdout ---- thread 'actors::indexer::tests::test_indexer_triggers_commit_on_drained_mailbox' panicked at 'assertion failed: `(left ==...
``` test cluster::tests::test_chitchat_state_set_high_number_of_tasks ... FAILED failures: ---- cluster::tests::test_chitchat_state_set_high_number_of_tasks stdout ---- thread 'cluster::tests::test_chitchat_state_set_high_number_of_tasks' panicked at 'called `Result::unwrap()` on an `Err` value: Elapsed(())', quickwit-cluster/src/cluster.rs:1049:14 note: run with `RUST_BACKTRACE=1` environment variable to display...