Michael McCandless comments

Results 335 comments of


                                            Michael McCandless

Introduce new encoding of BPV 21 for DocIdsWriter used in BKD Tree

> @mikemccand -- did you mean to close this PR? Ugh, no I did not! Sorry, I'll reopen!! I somehow fumble-finger'd something, adding a comment before I was done editing,...

Create tooling to measure quantization error

`KnnGraphTester.java` already reports some interesting stats about the HNSW graph ... maybe it could also measure/aggregate/report the quantization error?

Create a simple vector inspector tool

The tool could also report some aggregate stats, like per-dimension variance, or, do all/some dimensions have negative values, etc.

Create a simple vector inspector tool

Awesome! Let's start with that! I'll go merge it :) Thanks @msokolov

HyphenationCompoundWordTokenFilter fixed token position and preserves original token

To address your 2nd idea (increment the position for each sub-word in the compound word), I think we'd need to create a graph-aware `CompoundWordTokenFilter`. It would also emit `PositionLengthAttribute`, and...