Support Elasticsearch aliases

[goran-rumin]

Problem

The connector currently (version 11.1.3) doesn't support writing to Elasticsearch alias. Aliases are a convenient way to make the management of the underlying indices easy - like mapping updates, index rollover, etc. That, combined with the inability to use topic name transforms due to async commit makes alias usage very attractive.

Solution

Expanded index existence checks with alias existence check to prevent new index creation (and subsequent failing) when topic name corresponds to an alias.

Does this solution apply anywhere else?

• [ ] yes
• [ ] no

If yes, where?

Test Strategy

Testing done:

• [x] Unit tests
• [x] Integration tests
• [x] System tests
• [x] Manual tests

Release Plan

[goran-rumin]

The 3 build steps that are failing all have the same error message We have disabled builds for pull requests created by the open source communitydue to build system maintenance.We are working to finish it soon., so the build is not failing due to the code change. If this is expected, please ignore this comment, if not, I would kindly ask for your assistance with the issue.

[kpatelatwork]

@goran-rumin Thanks for the contribution, I will request to consider this in the pipeline for Q1 planning.

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[Bhashit]

@kpatelatwork was this ever included in the planning?

[kpatelatwork]

@Bhashit this was considered but did not make it to this quarter. CC: @rajat-agarwal

[Lowess]

@kpatelatwork this is also a feature we are looking for, are there any considerations to put this ticket on the roadmap so that it can be released soon (Q2/Q3)? Thank you.

[snehashisp]

Thanks for the contribution @goran-rumin. I have added a couple of comments. Primarily my concern is the comment above.

[goran-rumin]

Thanks for reviewing @snehashisp, I added my responses to the comments. I kindly request your input on 2nd one, since it affects one of the features of the connector in case of alias usage.

[quanvo17]

In my case i need to pre-generate the mapping of indices and auto rollover for it. I tried using data stream but this connector doesn't support exists mapping for data stream (follow issues 614) so I opted for using alias to push data into indices auto rollover. Unfortunately that option doesn't work either. Is there any way to help me?