kafka-connect-elasticsearch

kafka-connect-elasticsearch copied to clipboard

Option to disable the auto generated document ID's

3

Hi We started to use this connector in production, before that we used Logstash / Filebeat without manually creating document ID's. After we started to use this connector, we see...

panda87

Add query-parameter support for index/bulk APIs

2

Adds processing for configuration properties of the form `elasticsearch.index.param.=`. The name/value should be a valid query-string parameter name and value for the Index/Bulk APIs, to be applied to API calls....

javabrett

Hi There, With the below properties i am unable to save the timestamp with the below specified format (string).i.e,(2020-01-26 12:30:34.945) etc.. And in mapping the type will be long even...

bh1r123

#396 new configuration option write.method "create"

6

Add the possibility to set `write.method` configuration option to `"create"`. If `write.method` is set to `create`, a new document is created if the id does not already exist. If a...

graham2071

geo_point support; questions so I can work toward submitting my PR

1

Up til now, I have been able to support geo_point with elastic by defining my elastic index myself. However, I have recently come across a domain where I have Avro...

nbuesing

Fails with Elasticsearch index templates with disabled _source

1

I've run into the issue where the tasks of the connector end up in a `FAILED` state when an Elasticsearch index configuration is managed with an index template that has...

dainiusjocas

Problems with geo_point

1

I'm trying to store a geo_point field within an elasticsearch index but the connector is not able to map the geo_point field. Following is my set-up: POST's Body to the...

albertostratio

Use Elasticsearch auto-generated ids for performance

2

this option is for someone who need better indexing performance but not need 'exactly once' https://www.elastic.co/guide/en/elasticsearch/reference/master/tune-for-indexing-speed.html#_use_auto_generated_ids

gigsda

Add support to map topic fields names to ES field names. It could be even be a mapping file which is later could be placed in `etc/kafka-connect-elasticsearch/config` (for example) and...

pavelpe

Document external version with custom modes supported

6

Here are issues with fixed ES document version: https://github.com/confluentinc/kafka-connect-elasticsearch/issues/142 https://github.com/confluentinc/kafka-connect-elasticsearch/issues/308 I implemented the feature for user need customize the ES external version by kafka message offset, kafka message timestamp, or...

hongphu8790