Paul Masurel comments

Results 356 comments of


                                            Paul Masurel

trafficstars

SSTableIndex could be a multi layer SSTable

Assigned to @trinity-1686a for the moment, but we don't even know if we want this.

Issue 1787 extended stats

@PSeitz can you review?

Indexing an array of small pieces of text is much slower than indexing a big string

@trinity-1686a can you have a look at this?

Missing search results with in memory index

Yes. You can reload the index manually though. @PSeitz You added the good first issue label? Do you think we should do something here?

About range query performance questions.

You just need to add `--release` to you `cargo run` or `cargo test` command

Pluggable compressor support, or at least just zstd?

@rw So this is not well documented but lz4 is not the only option actually. Snappy is also available. The choice between snappy and lz4 is controlled by a compilation...

Pluggable compressor support, or at least just zstd?

@rw So is it something you need / want to work on?

Support adding fields to an existing index

@PingXia-at can you confirm this is needed for tantivy and not quickwit? (We have plans on how to handle schema changes in quickwit.)

Add support for `interval` field for Date histogram

@PSeitz Can you take care of this? We can also discuss long term plans to ditch the JSON representation of aggregations in tantivy, and just have agregation definition "objects" in...

Improve SSTable format... or find another dictionary format?

Yes you are correct. Having a bunch of fst blocks would solve the IO problem too. Another reason we picked `sstable` is because iterating through them is much faster and...