seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

[Umbrella][Feature][Connector-V2][Docs] Refactor connector-v2 docs using unified format

Open TyrantLucifer opened this issue 1 year ago • 18 comments

Code of Conduct

Search before asking

  • [X] I had searched in the issues and found no similar issues.

Describe the proposal

According to #4544 , we will start refactor connector-v2 docs to improve user experience.

Task list

  • [x] Jdbc Connector - MySQL @zhilinli123
  • [ ] Kafka Connector @MonsterChenzhuo
  • [x] Http Connector @MonsterChenzhuo
  • [x] Mongodb Connector @MonsterChenzhuo
  • [ ] Clickhouse Connector @MonsterChenzhuo
  • [ ] My Hours @TaoZex
  • [ ] Klaviyo @TaoZex
  • [ ] lemlist @TaoZex
  • [ ] Onesignal @TaoZex
  • [ ] HDFS @lightzhao
  • [ ] Hive @lightzhao
  • [ ] PostgreSQL @zhilinli123
  • [ ] SQL Server Connector @zhangchengming601
  • [ ] Redshift Connector @zhangchengming601
  • [ ] db2 @zhangchengming601
  • [ ] Paimon @MonsterChenzhuo
  • [ ] Hbase @MonsterChenzhuo
  • [ ] Assert @MonsterChenzhuo
  • [ ] Console @MonsterChenzhuo
  • [ ] Doris @Carl-Zhou-CN
  • [ ] Hudi @Carl-Zhou-CN
  • [ ] S3 @EricJoy2048

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!

TyrantLucifer avatar Apr 14 '23 04:04 TyrantLucifer

mysql documentation improvements please assign to me

zhilinli123 avatar Apr 14 '23 06:04 zhilinli123

kafka documentation、http documentation、clickhouse documentation improvements please assign to me

MonsterChenzhuo avatar Apr 14 '23 12:04 MonsterChenzhuo

kafka sink端的partition参数存在误导,用户会理解成为sink端的并行度,建议修改一下,因为kafka的Connector的sink端的配置存在误导 sink { kafka { topic = "seatunnel" bootstrap.servers = "CentOS:9092" partition = 1 format = json kafka.request.timeout.ms = 60000 semantics = EXACTLY_ONCE } } 这里的partition是写入的分区,不是并行度,kafka文档的编写,也可以指定给我来完善

jiangzzwy avatar Apr 15 '23 09:04 jiangzzwy

Please assign me the connector documentation related to the SaaS API

TaoZex avatar Apr 17 '23 09:04 TaoZex

Please assign me the connector documentation related to the SaaS API

Can you explain which specific connectors are they?

EricJoy2048 avatar Apr 17 '23 09:04 EricJoy2048

Please assign me the connector documentation related to the SaaS API

Can you explain which specific connectors are they?

Thanks. Please assign My Hours、Klaviyo、lemlist、Onesignal connector doc to me.

TaoZex avatar Apr 17 '23 10:04 TaoZex

HDFS documentation、Hive documentation improvements please assign to me

lightzhao avatar Apr 17 '23 10:04 lightzhao

Hi all, there are any progress on it?

TyrantLucifer avatar Apr 26 '23 03:04 TyrantLucifer

Hi all, there are any progress on it?

Please help me with the final review of Mysql. It is basically finished @TyrantLucifer

zhilinli123 avatar Apr 26 '23 06:04 zhilinli123

PostgreSQL Connector Assign to me Thanks .

zhilinli123 avatar Apr 26 '23 06:04 zhilinli123

SQL Server documentation improvements please assign to me

zhangchengming601 avatar May 05 '23 02:05 zhangchengming601

Redshift documentation improvements please assign to me

zhangchengming601 avatar May 08 '23 10:05 zhangchengming601

https://github.com/apache/incubator-seatunnel/pull/4590

zhilinli123 avatar May 09 '23 13:05 zhilinli123

SqlServer : https://github.com/apache/incubator-seatunnel/pull/4721

zhilinli123 avatar May 09 '23 13:05 zhilinli123

Template PR please refer to:#4590 source document:https://github.com/apache/incubator-seatunnel/blob/dev/docs/en/connector-v2/source/Mysql.md?plain=1 sink document:https://github.com/apache/incubator-seatunnel/blob/dev/docs/en/connector-v2/sink/Mysql.md?plain=1 CC @ALL @MonsterChenzhuo @TaoZex @lightzhao @zhangchengming601

zhilinli123 avatar May 15 '23 07:05 zhilinli123

I want to try Doris and Hudi

Carl-Zhou-CN avatar May 31 '23 10:05 Carl-Zhou-CN

Please assign Paimon、hbase、Assert、Console to me.

MonsterChenzhuo avatar Jun 25 '23 15:06 MonsterChenzhuo

Please assign db2 to me.

zhangchengming601 avatar Jul 15 '23 08:07 zhangchengming601

I want to try redis,iceberg and kudu

Carl-Zhou-CN avatar Jul 18 '23 01:07 Carl-Zhou-CN

summary the status and the supported connector

name updated
AmazonDynamoDB N
Assert WIP
Cassandra N
Clickhouse WIP
Console WIP
DataHub N
DingTalk N
Doris WIP
Elasticsearch N
Email N
Fake N
Google-firestore N
Google-sheet N
Hbase WIP
Hive WIP
Hudi WIP
Iceberg Y
influxdb N
iotdb Y
JDBC Y
Kafka WIP
Kudu WIP
maxcompute N
Mongo Y
neo4j N
openmldb N
paimon WIP
pulsar N
rabbitmq N
redis WIP
rocketmq N
s3-redshift N
selectdb-cloud Y
sentry N
slack Y
socket N
starrocks Y
tablestore N
tdengine N
ftp (file) N
hdfs (file) WIP
local file (file) N
oss (file) N
oss-jindo (file) N
s3 (file) WIP
sftp (file) N
http Y
feishu (http) Y
github (http) N
gitlab (http) N
jira (http) N
klaviyo (http) WIP
lemlist (http) WIP
myhours (http) Y
notion (http) N
onesignal (http) WIP
persistiq (http) N
wechat (http) N

CDC:

name updated
mongo N
mysql N
sqlserver N

liunaijie avatar Jul 19 '23 06:07 liunaijie

Please assign starrocks and selected-cloud to me. I have submitted the pr.

TaoZex avatar Jul 21 '23 03:07 TaoZex

  • [Oracle] https://github.com/apache/seatunnel/pull/5239 @ic4y Done
  • [Oss] https://github.com/apache/seatunnel/pull/5233 @Hisoka-X open

zhilinli123 avatar Aug 09 '23 03:08 zhilinli123

hi, how is the progress of Connector document? @lightzhao @Carl-Zhou-CN @zhangchengming601

zhilinli123 avatar Aug 09 '23 15:08 zhilinli123

FakeSource, Socket ,RocketMQ Assign me

zhilinli123 avatar Aug 09 '23 15:08 zhilinli123

I want to try redis,iceberg and kudu

When can I test and use it sink to iceberg

zengqinchris avatar Nov 24 '23 03:11 zengqinchris