seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

[Improve][flink][Connector-V1] Improve druid and doris connector

Open enterwhat opened this issue 2 years ago • 6 comments

https://github.com/apache/incubator-seatunnel/issues/2893

feat #2893 : (1), solve the problem that the -i parameter cannot be passed in the placeholder of the source part of the configuration file that replaces the conf, and supports placeholder replacement like the sql part.

(2), solve druid's start_date, end_date through the command line -i to pass the parameter space, recognized as the parameter separator of the shell command line, so that the date format parameter of yyyy-MM-dd HH:mm:ss cannot be recognized as a whole, resulting in running Errors, use specific placeholders by default, can be customized

(3), customize the output separator of druid to support importing into doris

(4), replace the default delimiter of doris to solve the problem that " "(\t) in the column value affects column recognition.

(5), druid adds user, password parameter authentication support

(6), provide provided annotation for the package that the druid connector can rely on seatunnel

enterwhat avatar Sep 27 '22 02:09 enterwhat

Hi, @enterwhat . Thank's for your contribution. Please change the pr comment to english.

EricJoy2048 avatar Sep 27 '22 02:09 EricJoy2048

done

enterwhat avatar Sep 28 '22 03:09 enterwhat

image https://github.com/apache/incubator-seatunnel/actions/runs/3132748547/jobs/5086755036

hailin0 avatar Sep 28 '22 03:09 hailin0

Hi, @enterwhat . Thank's for your contribution. Please change the pr comment to english.

I have commit new commits, should I push a new pr?

enterwhat avatar Sep 29 '22 08:09 enterwhat

image

https://github.com/apache/incubator-seatunnel/actions/runs/3132748547/jobs/5086755036

I have fixed this

enterwhat avatar Oct 11 '22 09:10 enterwhat

Hi, @enterwhat . Thank's for your contribution. Please change the pr comment to english.

any problem with this pr? how long will this be reviewed again?

enterwhat avatar Oct 13 '22 07:10 enterwhat

hi, thanks for your contribution, dev branch will no longer maintain the V1 version of the connector, so I will close this PR, If you are interested in this, you can contribute the corresponding V2Connector https://github.com/apache/incubator-seatunnel/tree/dev/seatunnel-connectors-v2

CalvinKirs avatar Jan 17 '23 07:01 CalvinKirs