datahub icon indicating copy to clipboard operation
datahub copied to clipboard

feat(ingest/kafka-connect): Add more connectors the regexp transformation support

Open treff7es opened this issue 10 months ago • 1 comments

This pull request introduces a new RegexRouterTransform helper class to handle Kafka Connect RegexRouter transformations, and integrates it across multiple sink connector parsers (S3SinkParser, SnowflakeParser, and BQParser). The changes improve the handling of topic transformations by centralizing the logic and ensuring compatibility with Kafka Connect's RegexRouter. Additionally, type annotations and minor refactoring have been added for better code clarity and maintainability.

treff7es avatar Jun 11 '25 13:06 treff7es

Codecov Report

Attention: Patch coverage is 95.06173% with 4 lines in your changes missing coverage. Please review.

:white_check_mark: All tests successful. No failed tests found.

Files with missing lines Patch % Lines
.../ingestion/source/kafka_connect/sink_connectors.py 95.06% 4 Missing :warning:

:loudspeaker: Thoughts on this report? Let us know!

codecov[bot] avatar Jun 11 '25 13:06 codecov[bot]