nrtsearch
nrtsearch copied to clipboard
Yelp
A high performance gRPC server on top of Apache Lucene
Is it currently supported (or planned) to search multiple indices, expressed by comma separated list or wildcard/regex with one search request? Like `"indexName": "index1,index2,myind*"`
Any plans to open source the K8s operator mentioned in https://engineeringblog.yelp.com/2021/09/nrtsearch-yelps-fast-scalable-and-cost-effective-search-engine.html ?
Refactor doc value loading a bit: - Load values as primitives where possible to avoid mandatory auto-boxing - Stop using `trimToSize`, since less resizing is more important than heap space...
Starting index on replica from a backup when the index is already downloaded before bugs out S3 download with the log `Not all bytes were read from the S3ObjectInputStream` being...
This results in an error like this: ``` Apr 06, 2021 3:33:40 PM com.yelp.nrtsearch.server.grpc.LuceneServer$LuceneServerImpl startIndex WARNING: error while trying to start index test_idx java.lang.IllegalArgumentException: index test_idx was not saved or...
Add arcDistance method for Locations (GeoPoint). Should use [Haversine distance](https://en.wikipedia.org/wiki/Haversine_formula) for the calculation. This only applies to single location, and not a multi-valued locations.
Error on adding documents to Primary: ``` Nov 04, 2020 1:54:26 AM com.yelp.nrtsearch.server.grpc.LuceneServer$LuceneServerImpl$1 onCompletedForIndex WARNING: error while trying to addDocuments java.util.concurrent.ExecutionException: java.lang.IllegalStateException: a non-null TaxonomyWriter must be provided when indexing...
`indices` in `GlobalState` is synchronized in the `getIndex` method: https://github.com/Yelp/nrtsearch/blob/6b2166948728e0a2c87b3c227b401781e0be38b6/src/main/java/com/yelp/nrtsearch/server/luceneserver/GlobalState.java#L234 This method is called in a lot of places (via another getIndex method) and we should consider removing the synchronization....
Following are the results when nrtsearch is started with restored state and start index is called: 1. Primary: start index fails with index not saved or committed message in exception...