monstache
monstache copied to clipboard
How can mongodb set synchronization interrupt continue
Hello, when I use monstache to perform full synchronization of mongodb sets, there is an abnormal interrupt in elasticsearch. At this time, I can only kill the process and start synchronization again. Is there any way to realize similar breakpoint continuation?
With 200 million data, it took about 5 days to synchronize 30 million unexpected interruptions. At present, it is estimated that it will take a long time to catch up with the progress of the interruption.
If there is another interruption next time, it may take me twice as long to complete the full synchronization.
this is my error.log
ERROR 2022/05/23 14:27:06 elastic: bulk processor "monstache" was unable to perform work: Post "http://119.3.44.220:9200/_bulk": write tcp 192.168.1.105:39516->xxx.x.xx.xxx:9200: write: connection timed out ERROR 2022/05/23 14:27:06 elastic: bulk processor "monstache" is waiting for an active connection ERROR 2022/05/23 14:27:12 Error performing direct read of collection company.comp: (CursorNotFound) cursor id 6912934598552064249 not found
thank you