logstash-input-mongodb
logstash-input-mongodb copied to clipboard
Missing data problem and data update question
Hi, I’m using logstash-input-mongodb to import my data from mongodb to ELK. But when it was done, I found that there is one document missing (I have 17781 docs in mongodb but only got 17780 docs in ELK).
I used the “normal” way to install the plugin through command bin\logstash-plugin install logstash-input-mongo
.
So can anyone help me on this problem?
Also, I found that when there is a change on the source db in mongo, this plugin can not detect it and import new data. And I didn’t found any schedule settings (like jdbc input plugin) which allow me to call my data regularly. So can anyone tell me how to keep data updated with mongodb using this plugin?
Thank you!
+1 but I have 399712 docs in mongodb but only got 399700 docs in ELK
now I had another try, which only 24 docs in mongo and 23 docs in ELK. can anyone help us? @phutchins
I sorted by _id and found it was the first doc (smallest _id) didn't import into ELK
What's been done in this issue's regard? Its been a long time since this issue has been reported and still I am also getting the same problem i.e First record goes missing in ELK.