flink-connector-elasticsearch icon indicating copy to clipboard operation
flink-connector-elasticsearch copied to clipboard

[FLINK-38447] Add table sink support for Elasticsearch 8 connector

Open lwn3148 opened this issue 2 months ago • 1 comments

Currently, the Elasticsearch 8 connector lacks a Table API sink implementation. This contribution adds a Table sink to the connector. To maintain configuration consistency with existing Elasticsearch connectors (e.g., ES 6/7), some utility classes and configuration definitions were directly reused from the base module, but the configuration options are adapted to the capabilities of the Elasticsearch8AsyncSink.

Key configuration changes include:

Removed options not supported by Elasticsearch8AsyncSink:

  • sink.bulk-flush.backoff.strategy
  • sink.bulk-flush.backoff.max-retries
  • sink.bulk-flush.backoff.delay

Added new options:

  • sink.bulk-flush.max-buffered-actions
  • ssl.certificate-fingerprint

Retained and aligned all other options with the Elasticsearch8AsyncSink configuration.

lwn3148 avatar Sep 27 '25 18:09 lwn3148