transporter icon indicating copy to clipboard operation
transporter copied to clipboard

SSL is not enabled on the server from postgresql to elasticsearch

Open adrianovieira opened this issue 3 years ago • 0 comments

Directions

Issues are reserved for actionable bug reports and feature requests.

Before opening an issue, search for similar bug reports or feature requests. If no similar issue can be found, fill out either the "Bug Report" or the "Feature Request" section below. Erase the other section and everything on and above this line.

Please note, the quickest way to fix a bug is to open a Pull Request.

Bug report

Relevant pipeline.js:

var source = postgres({
  "uri": "postgresql://user:pass@localhost:5432/mydatatests",
  "ssl": true
  // or
  // "ssl": false
  // "debug": true
  // "tail": false,
  // "replication_slot": "slot"
})

var sink = elasticsearch({
  "uri": "http://localhost:9200/mydatatests",
  "ssl": true
  // or
  // "ssl": false
  // "timeout": "10s", // defaults to 30s
  // "aws_access_key": "ABCDEF", // used for signing requests to AWS Elasticsearch service
  // "aws_access_secret": "ABCDEF" // used for signing requests to AWS Elasticsearch service
  // "parent_id": "elastic_parent" // defaults to "elastic_parent" parent identifier for Elasticsearch
})

t.Source("source", source, "/.*/").Save("sink", sink, "/.*/")

System info:

  • Transporter version: dev
  • OS: fedora-32
  • DB version(s): postgresql-9.6, elasticsearch-7.9.3

Reproducible Steps:

  1. docker run --rm -it --name postgres -p 5432:5432 -e POSTGRES_USER=user -e POSTGRES_PASSWORD=pass -e POSTGRES_DB=mydatatests -v $(pwd)/mydatatests.sql:/docker-entrypoint-initdb.d/mydatatests.sql postgres:9.6
  2. dockerrun --rm -it --name elasticsearch -p 9200:9200 -p 9300:9300 -e "discovery.type=single-node" docker.elastic.co/elasticsearch/elasticsearch:7.9.3
  3. ./transporter run -log.level "debug" pipeline.js

What did you expect to happened?

Data be transported to elasticsearch

What actually happened?

error:

INFO[0000] starting with metadata map[]                  name=source path=source type=postgres
INFO[0000] adaptor Starting...                           name=source path=source type=postgres
INFO[0000] boot map[sink:elasticsearch source:postgres]  ts=1615056028522159759
INFO[0000] adaptor Listening...                          name=sink path=source/sink type=elasticsearch
INFO[0000] adaptor Stopping...                           name=source path=source type=postgres
INFO[0000] adaptor Stopped                               name=source path=source type=postgres
INFO[0000] adaptor Stopping...                           name=sink path=source/sink type=elasticsearch
INFO[0000] received stop, message buffer is empty, closing... 
INFO[0000] adaptor Listen closed...                      name=sink path=source/sink type=elasticsearch
INFO[0000] adaptor Stopped                               name=sink path=source/sink type=elasticsearch
INFO[0000] closing BulkProcessor                         version=5 writer=elasticsearch
INFO[0000] metrics source records: 0                     path=source ts=1615056028524147030
INFO[0000] metrics source/sink records: 0                path=source/sink ts=1615056028524148609
INFO[0000] exit map[sink:elasticsearch source:postgres]  ts=1615056028524149067
pq: SSL is not enabled on the server

Feature Request

Opening a feature request kicks off a discussion.

Proposal:

adrianovieira avatar Mar 06 '21 18:03 adrianovieira