kafka-connect-elasticsearch icon indicating copy to clipboard operation
kafka-connect-elasticsearch copied to clipboard

Add Scripted Upsert Functionality

Open NicholasDCole opened this issue 11 months ago • 3 comments

Problem

Scripted Upserts are not currently possible inside of the Update Request sent to ElasticSearch

Also, the Kafka Payload is always sent in as either doc or upsert.

Solution

Add SCRIPTED_UPSERT write.method and custom logic in DataConverter.java to handle parameter injection as well as script injection into ES UpdateRequest

Does this solution apply anywhere else?
  • [ ] yes
  • [x] no
If yes, where?

Test Strategy

Testing done:
  • [x] Unit tests
  • [ ] Integration tests
  • [ ] System tests
  • [ ] Manual tests

Release Plan

NicholasDCole avatar Mar 08 '24 23:03 NicholasDCole

CLA assistant check
All committers have signed the CLA.

cla-assistant[bot] avatar Mar 08 '24 23:03 cla-assistant[bot]

Please review @sp-gupta @kkonstantine @snehashisp

NicholasDCole avatar Mar 12 '24 19:03 NicholasDCole

Please review @sp-gupta @kkonstantine @snehashisp

NicholasDCole avatar Mar 21 '24 16:03 NicholasDCole