snowflake-kafka-connector icon indicating copy to clipboard operation
snowflake-kafka-connector copied to clipboard

SNOW-630885: Support schema evolution with schematization

Open sfc-gh-tzhang opened this issue 2 years ago • 2 comments

This PR adds support to do schema evolution through ALTER TABLE command when there is schema mismatch between the kafka message and the table schema

Kafka Connector Schematization full design doc

sfc-gh-tzhang avatar Oct 12 '22 06:10 sfc-gh-tzhang

Codecov Report

Merging #501 (18acfd3) into master (38d2cae) will increase coverage by 0.55%. The diff coverage is 81.60%.

@@            Coverage Diff             @@
##           master     #501      +/-   ##
==========================================
+ Coverage   87.11%   87.67%   +0.55%     
==========================================
  Files          47       47              
  Lines        3957     4104     +147     
  Branches      418      446      +28     
==========================================
+ Hits         3447     3598     +151     
+ Misses        348      333      -15     
- Partials      162      173      +11     
Impacted Files Coverage Δ
.../kafka/connector/SnowflakeSinkConnectorConfig.java 86.54% <ø> (ø)
...tor/internal/streaming/SnowflakeSinkServiceV2.java 76.64% <0.00%> (+1.79%) :arrow_up:
...nector/internal/streaming/SchematizationUtils.java 65.85% <65.85%> (ø)
...nnector/internal/SnowflakeConnectionServiceV1.java 80.86% <82.55%> (+0.38%) :arrow_up:
...ctor/internal/streaming/TopicPartitionChannel.java 91.76% <97.22%> (+1.76%) :arrow_up:
...lake/kafka/connector/internal/SnowflakeErrors.java 97.02% <100.00%> (+0.12%) :arrow_up:
...a/connector/internal/streaming/StreamingUtils.java 93.67% <100.00%> (+0.24%) :arrow_up:
...owflake/kafka/connector/records/RecordService.java 91.10% <100.00%> (+2.91%) :arrow_up:

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

codecov-commenter avatar Oct 12 '22 07:10 codecov-commenter

bump, PTAL, thanks!

sfc-gh-tzhang avatar Oct 17 '22 20:10 sfc-gh-tzhang