Jan Niestadt

Improve documentation

2

# BlackLab Server requests - [x] For example, it is not very clear that the `patt` parameter is in Corpus Query Language (unless you override that with `pattlang`, which in...

Option to return whole sentence as context

3

Right now, each match is returned with a fixed number of words as context (wordsaroundhit parameter). We would like to have an option to return matches with the whole sentence...

Change from Java EE to Jakarta EE to allow BLS to run in Tomcat 10

12

see https://inl.github.io/BlackLab/blacklab-server-overview.html#installation

Switch default XML parser to Saxon?

1

BlackLab uses the XML library VTD-XML by default for processing documents while indexing. This only supports XPath 1.0. @eduarddrenth made it possible to use Saxon, a more feature-rich (supports XPath...

Aggregate javadocs from multiple modules

1

The Javadocs online are now only for the blackLab-engine module. Ideally the Javadocs for all the modules would be aggregated. See https://maven.apache.org/plugins/maven-javadoc-plugin/examples/aggregate.html

Try to ensure we access the forward index sequentially

2

HitsFromQueryParallel may add documents in more or less random order because documents from different segments are added in parallel. This may lead to thrashing the disk cache if we're sorting/grouping...

Similar to changes in HitGroupsTokenFrequencies; it doesn't matter if we retrieve more than maxHitsToRetrieve as this is only a guideline.

Store full indexing configuration with every index?

1

We have a server where users can create a custom indexing configuration and update data to be indexed. This server is running an older version of BlackLab and some of...

Maybe the terms file could be memory-mapped? The format would probably need to change for this. If we integrate the forward index and content store with Solr, we will probably...

Use slices instead of leaves for concurrency

1

We currently use LeafReaders for concurrently gathering hits. They are divided over the available search threads more or less randomly. The problem is that each LeafReader searches a segment, which...