transporter icon indicating copy to clipboard operation
transporter copied to clipboard

Sync new collections from MongoDB with tail option

Open pacomf opened this issue 6 years ago • 2 comments

Feature Request

I need sync two mongo databases continuously (with tail option, to emulate a continuos replication backup). All is work with add/update/delete documents for collections existing in the source database, but when i added a new collection, the sink database doesn't replicate it.

Ideas?

pacomf avatar May 18 '18 15:05 pacomf

waiting..

pedrocarlos-ti avatar Dec 11 '18 17:12 pedrocarlos-ti

We build up the list of collections when the read initiates, and it does not get refreshed, even while tailing.

https://github.com/compose/transporter/blob/9e154e76b7d2977d9ac7756660779b512cace87f/adaptor/mongodb/reader.go#L61

Downstream from there you can see that we set up tailing specific to each enumerated collection.

johnnason avatar Dec 11 '18 18:12 johnnason