abc icon indicating copy to clipboard operation
abc copied to clipboard

HELP with abc import.

Open rolfnufable opened this issue 6 years ago • 9 comments

Description : I cannot import mongodb data to my elasticsearch

Hi I'm using abc 0.5.0 as a means to import data from my Mongodb (ip 192.168.20.130 this has a security onion OS installed in it) to my elasticsearch (IP 192.168.20.133 this is a centos 7 machine)

for now I'm using the command on the centos 7 machine

abc import --src_type='mongodb' --src_uri="mongodb://username:[email protected]:27017 " "http://localhost :9201/index"

it shows the error this error

error connection , no reachable servers ..

both machines can ping each other and both machines have their firewalls off ( for testing purposes)

I even allowed ports 27017 and 9201 to go through their firewalls ( being desperate here )

What am I doing wrong here? am I missing some steps to import the mongodb data to elastic search??

PS. I tried using transporter too but failed to run ( probably the same error)

Checks
  • [x ] I have mentioned my abc version in the issue, if applicable.
  • [x ] This issue is not a duplicate.
  • [x ] This issue has a description.

rolfnufable avatar Mar 01 '18 02:03 rolfnufable

@rolfnufable any news here? i've go the same issue

superbarne avatar Aug 22 '18 15:08 superbarne

This might likely be due to your host server requiring SSL connection. We have added --ssl switch recently which when set to true will connect to the Mongo server with SSL enabled.

If this persists with the latest version of ABC, feel free to comment here and I will re-open the issue.

siddharthlatest avatar Sep 13 '18 19:09 siddharthlatest

Hi,

I tried the same with this command:

abc import --ssl=true --src_type=mongodb --src_uri="mongodb://localhost:27001/mytest" "https://user:password@my_elastic_cloud_ip/mytest"

I'm getting the same error. I could connect the elastic cloud index via Dejavu.

burakkilic avatar Sep 29 '18 15:09 burakkilic

@burakkilic which version of ABC are you using?

Can you share the exact error you're seeing? Can you also share if you have setup oplog access?

siddharthlatest avatar Oct 01 '18 12:10 siddharthlatest

also seeing this issue; using mongodb atlas & elastic cloud

chrisdostert avatar Dec 20 '18 06:12 chrisdostert

also seeing this issue; using mongodb atlas & elastic cloud. Any progress guys?

filipeoliveira avatar Dec 27 '18 18:12 filipeoliveira

@filipeoliveira This typically happens when there is an issue with the connection strings used for the source/destination DBs. This isn't a bug with ABC, we have users who are using MongoDB Atlas with ABC without issues.

siddharthlatest avatar Dec 27 '18 18:12 siddharthlatest

For me, when I use curl it works (username and password embedded in URL), but when I use abc not (elastic cloud). It does work well on localhost, the problem is the authentication I think. Is there any workaround/something that can be done?

maayanorner avatar Jan 16 '19 11:01 maayanorner

@siddharthlatest Any update on the issue.

aleplusplus avatar Nov 05 '19 05:11 aleplusplus