Support upserts in FlinkDeltaSink

[gopik]

Existing implementation supports appends only. This feature request is to support upserts in a delta table that is sorted by it's primary key columns.

Here's a rough proposal of how we could implement this - https://docs.google.com/document/d/1b35eZnIZheZK05EhNkqFMpzU3mcPze5iE9XKJulbftg/edit#heading=h.35nkun2

cc: @dennyglee

[gopik]

Depends on https://github.com/delta-io/connectors/issues/371

[marimuthuvellingiri]

Hi @gopik / @dennyglee , I am trying to integrate delta sink connector with Flink for one of my usecase which needs UPSERT mode. Can you please let me know is there any update on this issue?

[mberchon]

Hi @dennyglee Is there an ETA for this so powerful feature ? :-)

[dennyglee]

We're still working on the roadmap due to all of these awesome requests. Will try to get the roadmap updated soon. Thanks for your patience!

[jalilalchy]

@dennyglee any update on priority for this?

[dennyglee]

Thanks for your patience @jalilalchy. While we haven't finalized the roadmap schedule, with everything else that we're working out, I'm a little concerned about the overall prioritization. @gopik any chance you would still be interested in contributing to this? Thanks!

[gopik]

@dennyglee Yes, I'm still interested in contributing to this feature.

[dennyglee]

Sorry for completely missing this message @gopik - my bad! This is so awesome to hear - please ping me on Delta Users Slack at your convenience and we can start the convo on this, eh?!

[vkorukanti]

This repo has been deprecated and the code is moved under connectors module in https://github.com/delta-io/delta repository. Please create the issue in repository https://github.com/delta-io/delta. See delta-io/connectors#556 for details.