seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

[Feature][Connector-V2][File] Add cos source&sink

Open dengd1937 opened this issue 1 year ago • 10 comments

Purpose of this pull request

close #4978

Check list

  • [ ] Code changed are covered with tests, or it does not need tests for reason:
  • [ ] If any new Jar binary package adding in your PR, please add License Notice according New License Guide
  • [ ] If necessary, please update the documentation to describe the new feature. https://github.com/apache/seatunnel/tree/dev/docs
  • [ ] If you are contributing the connector code, please check that the following files are updated:
    1. Update change log that in connector document. For more details you can refer to connector-v2
    2. Update plugin-mapping.properties and add new connector information in it
    3. Update the pom file of seatunnel-dist
  • [ ] Update the release-note.

dengd1937 avatar Jun 26 '23 16:06 dengd1937

please check ci error

hailin0 avatar Jun 26 '23 16:06 hailin0

please add docs & e2e testcase

https://github.com/apache/seatunnel/blob/dev/docs/en/connector-v2/sink/ https://github.com/apache/seatunnel/tree/dev/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-file-ftp-e2e

hailin0 avatar Jun 26 '23 17:06 hailin0

Please add License header.

TaoZex avatar Jun 28 '23 03:06 TaoZex

please add docs & e2e testcase

https://github.com/apache/seatunnel/blob/dev/docs/en/connector-v2/sink/ https://github.com/apache/seatunnel/tree/dev/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-file-ftp-e2e

update

dengd1937 avatar Jul 05 '23 14:07 dengd1937

test cos sink execl format result: config result

dengd1937 avatar Jul 06 '23 11:07 dengd1937

test cos sink json format result: image image

dengd1937 avatar Jul 06 '23 11:07 dengd1937

test cos sink orc format result: image image

dengd1937 avatar Jul 06 '23 11:07 dengd1937

test cos sink parquet format result: image image

dengd1937 avatar Jul 06 '23 11:07 dengd1937

test cos sink text format result: image image

dengd1937 avatar Jul 06 '23 11:07 dengd1937

add this module into dist pom.xml

update

dengd1937 avatar Jul 09 '23 03:07 dengd1937