seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

[Feature][Connector-V2] Support extract topic from SeaTunnelRow fields

Open TaoZex opened this issue 2 years ago • 2 comments

Purpose of this pull request

Support extract topic from SeaTunnelRow fields,use value of a field from upstream data as topic,the format is ${field_topic}, where topic is the name of one of the columns of the upstream data.

Check list

  • [ ] Code changed are covered with tests, or it does not need tests for reason:
  • [ ] If any new Jar binary package adding in your PR, please add License Notice according New License Guide
  • [ ] If necessary, please update the documentation to describe the new feature. https://github.com/apache/incubator-seatunnel/tree/dev/docs

TaoZex avatar Oct 19 '22 16:10 TaoZex

I suggest support mutile fields,and support combination of fixed string and field names, such as topic = "topic_${fieldName1}_${fieldName2}",reference https://github.com/apache/incubator-seatunnel/blob/dev/seatunnel-connectors-v2/connector-elasticsearch/src/main/java/org/apache/seatunnel/connectors/seatunnel/elasticsearch/serialize/index/IndexSerializerFactory.java

iture123 avatar Nov 10 '22 10:11 iture123

I suggest support mutile fields,and support combination of fixed string and field names, such as topic = "topic_${fieldName1}_${fieldName2}",reference https://github.com/apache/incubator-seatunnel/blob/dev/seatunnel-connectors-v2/connector-elasticsearch/src/main/java/org/apache/seatunnel/connectors/seatunnel/elasticsearch/serialize/index/IndexSerializerFactory.java

Thanks for your advice.

TaoZex avatar Nov 10 '22 10:11 TaoZex