kafka-connect-elasticsearch
kafka-connect-elasticsearch copied to clipboard
confluentinc
Kafka Connect Elasticsearch connector
**Issue:** My topic has a message with a String key set the `"1"`. When I set my connector to `"key.ignore": "false"` the Elasticsearch document id is: - `"_id" : """"1""""`...
setContentCompressionEnabled doesn't compress the request ("Determines whether the target server is requested to compress content.") Older versions used requestCompressionEnabled
Let's say I have two topics. One follows topic strategy and other follows topic record name strategy. How to configure these two topics? Thanks!
AWS Elasticsearch implements a custom signature method to authenticate users [0]. It would be nice to be able to use this connector to move data into AWS Elasticsearch clusters that...
Problem: To sink a JSON record via Kafka to Elastic Search via Elastic Sink Connector [ {"name" : "maddy"}, {"name" : "gene"} ] Observation: 1. Sending individual record `{"name" :...
Hello, I'm using ElasticsearchConnector with following config and es mapping: ```{ "mappings": { "_doc": { "dynamic": "false", "properties": { "locations": { "type": "nested", "properties": { "country": { "type": "text", "fields":...
## Problem If Elasticsearch indexer is highly concurrent, keys are used as ids, and indexer is set to delete records on `null` values, then not using external versioning for delete...
There's a compiled JAR-package on [Confluent Hub](https://www.confluent.io/hub/confluentinc/kafka-connect-elasticsearch) without [guava.jar](https://mvnrepository.com/artifact/com.google.guava/guava). But it depends on [Guava](https://github.com/google/guava) - #366 an #409. It is good idea to remove scope `test` from `pom.xml` for Guava...
Link to JIRA ticket - https://confluentinc.atlassian.net/browse/HCD-329 Added integration test using **EmbeddedConnectCluster** and [Pumba](https://github.com/alexei-led/pumba) for the following scenarios - **Elasticsearch Sink Connector** - End to End IT test (success scenario) -...
How do you feel about adding an option to treat kafka connect logical date fields (date, datetime, timestamp) as Elasticsearch date types? Both for schema creation and data conversion. For...
