flink-connector-elasticsearch
flink-connector-elasticsearch copied to clipboard
apache
Apache Flink connector for ElasticSearch
[FLINK-36143][ES6][ES7] Intro retry-on-conflict param to resolve Sink ES occurred "version conflict"
When I used ES connector Write update datas, it occurred "version conflict", like this " org.elasticsearch.index.engine.VersionConflictEngineException: [project][1140860]: version conflict, current version [5] is different than the one provided [4] "...
Supports specifying routing fields during write operations. Parameter name: sink.partition-routing.fields e.g. create temporary table order_info_sink ( id BIGINT, user_id BIGINT, order_id BIGINT, PRIMARY KEY (id) NOT ENFORCED ) WITH( 'connector'...
Supports specifying routing fields during write operations. Parameter name: sink.partition-routing.fields e.g. create temporary table order_info_sink ( id BIGINT, user_id BIGINT, order_id BIGINT, PRIMARY KEY (id) NOT ENFORCED ) WITH( 'connector'...
Explicitly set connector compatibility as string to prevent version comparison mismatch ### Purpose of the change * Set version as string to prevent version comparison mismatch. Issue has happened for...
Fixes FLINK-38054 I am not sure this is the best solution in this case, but it mitigates the original problem of Operation classes being invisible during deserialization. The PR branch...
Currently, the Elasticsearch 8 connector lacks a Table API sink implementation. This contribution adds a Table sink to the connector. To maintain configuration consistency with existing Elasticsearch connectors (e.g., ES...
This PR proposes to improve perf for Elasticsearch 8 connector. Currently, Elasticsearch 8 connector create a new `OperationSerializer` for each `Operation`. A large amount of `OperationSerializer`'s instances brings big overhead....
#39 support elasticsearch lookup join, but the lack of relevant documents
This commit introduces a new feature that allows for dynamic index generation in the Elasticsearch connector. The index name can now be constructed by appending a suffix derived from a...
[FLINK-38371][Connectors / ElasticSearch] Add `sink.retry-on-conflicts` option to Elasticsearch Sink
This pull request introduces a new configuration option, sink.retry-on-conflicts, for the Elasticsearch table sink. This option allows users to specify the number of times to retry an update request when...