kafka-connect-elasticsearch
kafka-connect-elasticsearch copied to clipboard
confluentinc
Kafka Connect Elasticsearch connector
When attempting to write to ElasticSearch and an "Indexing record failed" error occurs, the connector dies without any retries. We do not even see the [retry log](https://github.com/confluentinc/kafka-connect-elasticsearch/blob/v13.0.0/src/main/java/io/confluent/connect/elasticsearch/RetryUtil.java#L171) execute. Kafka Connect...
Refs: - https://github.com/confluentinc/kafka-connect-elasticsearch/issues/223 - https://www.elastic.co/guide/en/elasticsearch/reference/current/mapping-routing-field.html - https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-bulk.html#bulk-routing - https://www.elastic.co/guide/en/elasticsearch/reference/current/parent-join.html ## Problem ElasticSearch `_routing` field currently is not supported. ## Solution ##### Does this solution apply anywhere else? - [x] yes...
Hello all, Does Elasticsearch sink support [Connect Reporter](https://docs.confluent.io/platform/current/connect/userguide.html#userguide-connect-reporter) ? If not is planned ? Many thanks in advance!
Doing `brew install openjdk@17` and editing ~/.mavenrc to have ``` export JAVA_HOME=/usr/local/Cellar/openjdk@17/17.0.2/libexec/openjdk.jdk/Contents/Home ``` resolved it. The error I was seeing (log below) is possibly caused by the dependency on org.apache.maven.plugins:maven-jar-plugin:2.6,...
## Problem Should be able to control if `INTERNAL` version is used for requests when `key.ignore` is set to false. The general scenario is duplicate records being indexed and the...
connector version: 11.0.0 When using `"key.ignore": false` and `"write.method": "insert"`, the connector set the document version (version appearing in Elasticsearch) to the record offset in Kafka, for a reason that...
Elasticsearch has support for [Ingest Pipelines](https://www.elastic.co/guide/en/elasticsearch/reference/5.2/ingest.html) to perform transformations on data before it is indexed. The indexing API requires a parameter to be passed to use a pipeline: ``` PUT...
It's being noticed that Kafka connect tasks are in 'Running States' but the internal consumers are dead i.e., no heartbeat/polling. There seems to be nothing noticeable on kafka-connect (ERROR ,...
## Problem Once we upgraded ES client to `7.9.3`, the method we were using for logging ES server versions was changed ## Solution Update to the newer way to getting...
