seatunnel
seatunnel copied to clipboard
apache
[Feature][Connector-V2] Support TableSourceFactory/TableSinkFactory on connector
Search before asking
- [X] I had searched in the feature and found no similar feature requirement.
Description
Purpose
Support TableSourceFactory/TableSinkFactory for connector-v2 source and sink. After https://github.com/apache/seatunnel/issues/5483 finnished. We should make sure all SeaTunnelSource and SeaTunnelSink created by TableSourceFactory and TableSinkFactory. To achieve the deprecation of Config at the connector level (use ReadonlyConfig for now), the deletion of obsolete prepare methods, the adaptation of CatalogTable feature, etc. Please refer JdbcSourceFactory/JdbcSinkFactory.
Please pick connector you want to implement it!
| Source/Sink | Connector | Contributer | Status | PR |
|---|---|---|---|---|
| Source | FakeSource | Done | ||
| Sink | Console | Done | ||
| Sink | Assert | Done | ||
| Source | Kafka | Done | ||
| Sink | Kafka | Done | ||
| Source | Http | @jackyyyyyssss | ||
| Sink | Http | @jackyyyyyssss | ||
| Sink | Feishu | |||
| Source | Socket | |||
| Sink | Hive | @qifanlili | ||
| Source | Hive | @qifanlili | ||
| Source | Clickhouse | @Carl-Zhou-CN | ||
| Sink | Clickhouse | @Carl-Zhou-CN | ||
| Sink | ClickhouseFile | |||
| Source | Jdbc | Done | ||
| Sink | Jdbc | Done | ||
| Source | Kudu | @Carl-Zhou-CN | Done | #5789 |
| Sink | Kudu | @Carl-Zhou-CN | Done | #5789 |
| Sink | EmailSink | |||
| Source | HdfsFile | @dengd1937 | ||
| Sink | HdfsFile | @dengd1937 | ||
| Source | LocalFile | @ruanwenjun | ||
| Sink | LocalFile | @ruanwenjun | Done | #5931 |
| Source | OssFile | |||
| Sink | OssFile | |||
| Source | OssJindoFile | |||
| Sink | OssJindoFile | |||
| Source | CosFile | |||
| Sink | CosFile | |||
| Source | Pulsar | |||
| Source | Hudi | |||
| Sink | DingTalk | |||
| Source | Elasticsearch | @Hisoka-X | ||
| Sink | Elasticsearch | @Hisoka-X | ||
| Source | IoTDB | |||
| Sink | IoTDB | |||
| Source | Neo4j | @FuYouJ | ||
| Sink | Neo4j | @FuYouJ | ||
| Source | FtpFile | @Hisoka-X | ||
| Sink | FtpFile | @Hisoka-X | ||
| Source | SftpFile | @Hisoka-X | ||
| Sink | SftpFile | @Hisoka-X | ||
| Sink | Socket | |||
| Source | Redis | @jackyyyyyssss | ||
| Sink | Redis | @jackyyyyyssss | ||
| Sink | DataHub | |||
| Sink | Sentry | |||
| Source | MongoDB | |||
| Sink | MongoDB | |||
| Source | Iceberg | |||
| Source | InfluxDB | @531651225 | ||
| Source | S3File | |||
| Sink | S3File | @chl-wxp | ||
| Source | AmazonDynamodb | |||
| Sink | AmazonDynamodb | |||
| Source | Cassandra | |||
| Sink | Cassandra | |||
| Sink | StarRocks | Done | ||
| Source | MyHours | |||
| Sink | InfluxDB | @531651225 | ||
| Source | GoogleSheets | |||
| Sink | GoogleFirestore | |||
| Sink | Tablestore | |||
| Source | Lemlist | |||
| Source | Klaviyo | |||
| Sink | Slack | |||
| Source | OneSignal | |||
| Source | Jira | |||
| Source | Gitlab | |||
| Source | Github | |||
| Source | Notion | |||
| Sink | RabbitMQ | |||
| Source | RabbitMQ | |||
| Source | OpenMldb | |||
| Source | SqlServer-CDC | Done | ||
| Sink | Doris | @EricJoy2048 | https://github.com/apache/seatunnel/pull/6354 | |
| Source | Maxcompute | |||
| Sink | Maxcompute | |||
| Source | MySQL-CDC | Done | ||
| Source | MongoDB-CDC | Done | ||
| Sink | S3Redshift | @chl-wxp | ||
| Source | TDengine | |||
| Sink | TDengine | |||
| Source | Persistiq | |||
| Sink | SelectDBCloud | @ic4y | ||
| Sink | Hbase | |||
| Source | StarRocks | |||
| Source | Rocketmq | |||
| Sink | Rocketmq | |||
| Source | Paimon | @TaoZex | ||
| Sink | Paimon | @TaoZex |
Code of Conduct
- [X] I agree to follow this project's Code of Conduct
Please assign me (S3Redshift sink,S3File sink）
https://github.com/apache/seatunnel/issues/5735 https://github.com/apache/seatunnel/issues/5736
Please assign me neo4j and Elastic search
Assgined neo4j to you. But ElasticSearch already have a PR https://github.com/apache/seatunnel/pull/6181
