seatunnel
seatunnel copied to clipboard
[Improve][Connector-V2][Kafka] Support extract topic from SeaTunnelRow field
Purpose of this pull request
Support extract topic from SeaTunnelRow field
For test :
source config :
sink config :
send records to topic:
Check list
- [ ] Code changed are covered with tests, or it does not need tests for reason:
- [ ] If any new Jar binary package adding in your PR, please add License Notice according New License Guide
- [ ] If necessary, please update the documentation to describe the new feature. https://github.com/apache/incubator-seatunnel/tree/dev/docs
- [ ] If you are contributing the connector code, please check that the following files are updated:
- Update change log that in connector document. For more details you can refer to connector-v2
- Update plugin-mapping.properties and add new connector information in it
- Update the pom file of seatunnel-dist
Add e2e testcase
Writing e2e test for this feature is not easy because the kafka sink connector send records without callback function, so I took a screenshot to prove that the feature is available.
Add e2e testcase
Writing e2e test for this feature is not easy because the kafka sink connector send records without callback function, so I took a screenshot to prove that the feature is available.
- Generate fixed data in the data source
- Use kafka sink to write topic
- Check the message of the topic
Add e2e testcase
Writing e2e test for this feature is not easy because the kafka sink connector send records without callback function, so I took a screenshot to prove that the feature is available.
- Generate fixed data in the data source
- Use kafka sink to write topic
- Check the message of the topic
Thanks for your advice.
I added e2e test for this feature and refactor the kafkaIT code.PTAL @hailin0 @EricJoy2048 @Hisoka-X
Let's waiting CICD.