kafka-connect-elasticsearch
kafka-connect-elasticsearch copied to clipboard
confluentinc
Kafka Connect Elasticsearch connector
Currently, Kafka connect elasticsearch doesn't support ingestion of nested documents. This seems like such an important feature to have. Is there any plan in near future to implement this?
This is a work in progress PR, please don't merge. This PR introduced a verification process to assure that no unexpected type is used, so problems like the ones described...
Currently type.name is set at connector instantiation and is static, regardless of how many topics the connector is consuming from. I would like to either see an option to map...
I noticed that documents indexed in elasticsearch have their ids in the following format `topic+partition+offset`. I would prefer to use id's generated by elasticsearch. It seems `topic+partition+offset` is not usually...
These questions are related to [the docu](https://docs.confluent.io/current/connect/kafka-connect-elasticsearch/index.html#delivery-semantics) that states: > Document-level update ordering is ensured by using the partition-level Kafka offset as the [document version](https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-index_.html#index-versioning), and using `version_mode=external`. **How can...
Hi, I am not sure if this issue is logged earlier but. Here is the issue that I am facing with: Using Kafka 0.11, Connect ES connector, ElasticSearch 5.2 1....
I recently upgraded my 4.1.1 version of kafka-connect-elasticsearch to take advantage of the newly added basic auth but seem to have hit a snag. One of my topics was holding...
Just I added a table in which reader can found the supported versions by kafka-connect-elasticsearch .
Suggestion for different default values for batch.size, max.buffered.records, and flush.timeout.ms
Hello. I just spent quite a while tweaking config values for an ES connector in my 0.11.0.1 & 3.3.0 distributed connector deployment. The connector was consuming a large backlog on...
Hi! Sometimes it's useful to take timestamp from kafka records as version number instead partition offset. For example when you add partitions in a target topic.
