elastic2-doc-manager icon indicating copy to clipboard operation
elastic2-doc-manager copied to clipboard

Is there any support of Elasticsearch 6.x ?

Open swifty-team opened this issue 6 years ago • 3 comments

It works fine for me in ES 5.x

But will it work for version 6.x?

Thanks

swifty-team avatar Jul 19 '18 14:07 swifty-team

I've tested with Elasticsearch 6.6.0 and it doesn't work due to a breaking change (Removal of mapping types).

pimartin avatar Feb 12 '19 14:02 pimartin

I made a fix at https://github.com/tigerking/elastic2-doc-manager which create dedicate index per database_collection(table) to meet my requirement. You can check if it works for you too.

tigerking avatar Aug 01 '19 10:08 tigerking

Using @tigerking's idea, here is the updated repo with support for ES 7.x going forward (no doc_type), and updated test cases.

The following are the changes/differences between elastic7-doc-manager and elastic2-doc-manager.

  1. MongoDB database + MongoDB collection is mapped to a single Elasticsearch index with the convention: {db}_{collection} where db and collection are the lowercase names of the MongoDB database and MongoDB collection.
  2. No more doc_type for ES indices.
  3. Removed mapper-attachment plugin which was responsible for parsing file attachments, and replaced it with newer ingest-attachment plugin.

All test cases pass with my new changes, I had to modify a small number of test cases.

To the authors, I've not published this to pypi, I would love some feedback before I do that. If raising a PR to this repo is instead the right way to proceed, I would be happy to do that as well.

Edit: Linking https://github.com/yougov/elastic2-doc-manager/issues/57

tmpaul06 avatar Sep 17 '19 04:09 tmpaul06