monstache icon indicating copy to clipboard operation
monstache copied to clipboard

How can mongodb set synchronization interrupt continue

Open xiaoli-yang opened this issue 2 years ago • 0 comments

Hello, when I use monstache to perform full synchronization of mongodb sets, there is an abnormal interrupt in elasticsearch. At this time, I can only kill the process and start synchronization again. Is there any way to realize similar breakpoint continuation?

With 200 million data, it took about 5 days to synchronize 30 million unexpected interruptions. At present, it is estimated that it will take a long time to catch up with the progress of the interruption.

If there is another interruption next time, it may take me twice as long to complete the full synchronization.

this is my error.log ERROR 2022/05/23 14:27:06 elastic: bulk processor "monstache" was unable to perform work: Post "http://119.3.44.220:9200/_bulk": write tcp 192.168.1.105:39516->xxx.x.xx.xxx:9200: write: connection timed out ERROR 2022/05/23 14:27:06 elastic: bulk processor "monstache" is waiting for an active connection ERROR 2022/05/23 14:27:12 Error performing direct read of collection company.comp: (CursorNotFound) cursor id 6912934598552064249 not found

thank you

xiaoli-yang avatar May 24 '22 01:05 xiaoli-yang