kafka-connect-storage-cloud
kafka-connect-storage-cloud copied to clipboard
Allow null values to be set to null for jsonformat
Problem
Using the JsonFormat to write "from" debezium to kafka and then using the s3sinkconnector to read from kafka and save to s3, causes null values to be stored always with their default values.
Solution
Therefore adding a new config property (for backwards compatibility) to allow the value transformer inside the s3sinkconnector to be configured correctly.
Tests for the configuration and and integration have been added as well.
This addresses #716, but for json, instead of avro
Does this solution apply anywhere else?
- [ ] yes
- [x] no
If yes, where?
Test Strategy
Testing done:
- [x] Unit tests
- [x] Integration tests
- [x] System tests
- [ ] Manual tests
Release Plan
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.