logstash-input-mongodb icon indicating copy to clipboard operation
logstash-input-mongodb copied to clipboard

Tail Mongo Oplog

Open gairom opened this issue 9 years ago • 7 comments

Hi, Is there any plans to implement tailing the Mongo oplog in order to pickup changes to existing docs?

gairom avatar Oct 16 '15 21:10 gairom

maybe somehow combine this with this plugin: https://github.com/stripe/mongoriver

gairom avatar Oct 16 '15 23:10 gairom

Actually, I would love to implement this. This is a great use case for this plugin. It might even be well suited as the default behavior.

I'll look into what this would take. Feel free to add any ideas or thoughts...

phutchins avatar Dec 09 '15 13:12 phutchins

Hi, defo this feature will make your plugin complete! it takes months already for mongodb team to upgrade their connector to support ES 2.x and frankly thats a little too long. +100

marcinkubica avatar Dec 17 '15 15:12 marcinkubica

Just an update... Haven't lost sight of this. Just been busy over the holidays. Plan on attacking this one soon. Help in the form of PR's is always welcome :).

If anyone is good with writing tests, that would be a huge help to the plugin...

phutchins avatar Feb 03 '16 14:02 phutchins

Just an update but this is one of the next tasks on my list. Hope to tackle soon...

phutchins avatar Feb 11 '16 13:02 phutchins

I am eager to use this feature for my problem set!

puneetjindal avatar Feb 25 '16 10:02 puneetjindal

Waiting for this feature, An other alternate method to get updated documents from mongo

CibilanJames avatar Oct 06 '16 11:10 CibilanJames