seatunnel
seatunnel copied to clipboard
[Feature][Connector-V2] Support extract topic from SeaTunnelRow fields
Purpose of this pull request
Support extract topic from SeaTunnelRow fields,use value of a field from upstream data as topic,the format is ${field_topic}, where topic is the name of one of the columns of the upstream data.
Check list
- [ ] Code changed are covered with tests, or it does not need tests for reason:
- [ ] If any new Jar binary package adding in your PR, please add License Notice according New License Guide
- [ ] If necessary, please update the documentation to describe the new feature. https://github.com/apache/incubator-seatunnel/tree/dev/docs
I suggest support mutile fields,and support combination of fixed string and field names, such as topic = "topic_${fieldName1}_${fieldName2}",reference https://github.com/apache/incubator-seatunnel/blob/dev/seatunnel-connectors-v2/connector-elasticsearch/src/main/java/org/apache/seatunnel/connectors/seatunnel/elasticsearch/serialize/index/IndexSerializerFactory.java
I suggest support mutile fields,and support combination of fixed string and field names, such as topic = "topic_${fieldName1}_${fieldName2}",reference https://github.com/apache/incubator-seatunnel/blob/dev/seatunnel-connectors-v2/connector-elasticsearch/src/main/java/org/apache/seatunnel/connectors/seatunnel/elasticsearch/serialize/index/IndexSerializerFactory.java
Thanks for your advice.