kafka-connect-storage-cloud icon indicating copy to clipboard operation
kafka-connect-storage-cloud copied to clipboard

Allow null values to be set to null for jsonformat

Open bjoernhaeuser opened this issue 1 year ago • 2 comments

Problem

Using the JsonFormat to write "from" debezium to kafka and then using the s3sinkconnector to read from kafka and save to s3, causes null values to be stored always with their default values.

Solution

Therefore adding a new config property (for backwards compatibility) to allow the value transformer inside the s3sinkconnector to be configured correctly.

Tests for the configuration and and integration have been added as well.

This addresses #716, but for json, instead of avro

Does this solution apply anywhere else?
  • [ ] yes
  • [x] no
If yes, where?

Test Strategy

Testing done:
  • [x] Unit tests
  • [x] Integration tests
  • [x] System tests
  • [ ] Manual tests

Release Plan

bjoernhaeuser avatar May 16 '24 20:05 bjoernhaeuser

CLA assistant check
All committers have signed the CLA.

cla-assistant[bot] avatar May 16 '24 20:05 cla-assistant[bot]

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

cla-assistant[bot] avatar May 16 '24 20:05 cla-assistant[bot]