logstash-input-mongodb icon indicating copy to clipboard operation
logstash-input-mongodb copied to clipboard

This project is dead?

Open Jose92 opened this issue 4 years ago • 6 comments

Hello this project is dead?

Jose92 avatar Jun 07 '20 22:06 Jose92

It seems that way...

My workaround was to use mongosql or a JDBC driver from DbSchema (check: https://dbschema.com/jdbc-driver/MongoDb.html). Notice that mongosql generates "subtables" for the array fields and you can consult using SQL 92.

I prefered the JDBC driver due to the fact that almost any shell query or function would work, like: db.MyCollection.find()

I hope it helps.

matiasperrone avatar Jul 17 '20 15:07 matiasperrone

@matiasperrone I was looking for ways to sync data between mongodb to elasticsearch. The current plugin do most of basics stuff, but it does not support synching update/deletion of documentation. While other options seems deprecated for ES7.x, I also found logstash with JDBC driver looks most promising.

hardiksondagar avatar Sep 19 '20 05:09 hardiksondagar

After spending hours figuring out of data pipeline, I end up writing custom python script to ingest data from mongodb to elasticsearch https://github.com/hardiksondagar/mongodb-to-elasticsearch

hardiksondagar avatar Sep 21 '20 12:09 hardiksondagar

@hardiksondagar seems that the new 7.9 has a beats plugin, so seems what are you looking for. Check this out https://www.elastic.co/es/blog/whats-new-elastic-observability-7-9-0-unified-agent-kpi-overview-dashboard

matiasperrone avatar Sep 21 '20 13:09 matiasperrone

Using JDBC driver from DbSchema is the better option, I have shared in this post my configuration in case it can help someone with this same problem, Regards.

sergio11 avatar Oct 25 '20 10:10 sergio11

I managed that with this updated infos using jdbc connection.

vinirib avatar May 31 '24 19:05 vinirib