Peter Johnson

enable docvalues for source_id field

1

draft PR to test the effect of enabling `docvalues` for the `source_id` field. this is motivated by the discussion in https://github.com/pelias/api/pull/1608 it is hoped that this field can be used...

combine ngram and full-token fields

2

I think this has been discussed in the past but there was no issue open for it. **background** For many fields we have two 'subfields', one which contains the complete...

add dedicated concordance field

5

ping! @pelias/contributors this PR is a discussion with code attached 🚀 this year has seen some work around recording and exposing 'concordances' (the WOF term for foreign key references). these...

disable field norms

5

this DRAFT PR isn't meant to be merged, I'm just curious as to what a planet build would look like with `norms: false` on all the fields. it's been a...

discuss: similarity algorithms

9

For years now we've been fighting the `TF/IDF` algorithm and more recently we've changed to the `BM25` similarity algo which is much better for short texts like ours but it's...

There is currently no linting or syntax checking enabled for this repo, which means that there are variable levels of code quality throughout the codebase. There are a few options...

apply unidirectional synonyms at query-time

4

as of [today](https://github.com/pelias/schema/pull/407) we finally removed all unidirectional synonyms (ones using the `a=>b` syntax) from our default synonyms file 🎉 unfortunately, I realized that there is a bug which is...

Consider adding apostrophe tokenfilter

1

As reported in https://github.com/pelias/pelias/issues/847, we can improve fuzzy-matching by applying an apostrophe tokenfilter. https://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-apostrophe-tokenfilter.html

add Spanish street suffix synonyms

2

today I noticed that we were not able to match the query `Av Michoacán` against the indexed term `Avenida Michoacán` this PR adds Spanish language synonyms for street suffixes. consider...

add normalizer for keyword fields

4

cherry-picked from https://github.com/pelias/schema/pull/412 and based on https://github.com/pelias/schema/pull/414. This PR adds a `normalizer` which is the nearest thing to an `analyzer` for `keyword` fields. more info here: https://github.com/elastic/elasticsearch/issues/18064 This allows us...