Mongo2ES icon indicating copy to clipboard operation
Mongo2ES copied to clipboard

Transform function triggered two times

Open ricardolimaui opened this issue 6 years ago • 4 comments

This already happen to someone else ?

I20190416-12:15:41.706(1)? I am in the transform function I20190416-12:15:41.707(1)? I am in the transform function I20190416-12:15:41.707(1)? updating doc 123456789 to ES

This bring errors because are transforming two times. It is the normal behaviour?

Thank you for the software!

Using Elasticsearch 5.6.10

ricardolimaui avatar Apr 16 '19 11:04 ricardolimaui

Sorry I am not sure if this is a bug or not, I don't use mongo2es anymore. But perhaps it could be two different database updates being picked with mongo oplog and then being transformed?

Maybe mongo2es doesn't work well anymore with newer versions of mongodb... Haven't tried

Alino avatar Apr 17 '19 18:04 Alino

Did you found another better software to do this ? I know the software is not catching when a new field is created in a existing file and when it create an entire copy it works ok.

In principle it should catch only one change because it was what I change manually in the db. But thank you for your help :D

ricardolimaui avatar Apr 18 '19 09:04 ricardolimaui

I have left the project which required moving mongo data do elasticsearch. So I don't use mongo2es, or any alternative.

Perhaps if you watch the mongo oplog by yourself that could be a good option. I would look into something like npm mongo-oplog-watch

Alino avatar Apr 23 '19 16:04 Alino

ok ok thank you for the help

ricardolimaui avatar Apr 30 '19 10:04 ricardolimaui