seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

[Feature][Connector-V2][JDBC] support sqlite Source & Sink

Open nutsjian opened this issue 3 years ago • 11 comments

Purpose of this pull request

[JDBC] SqLite Connector

Due to the type affinity of sqlite3, and the dynamic data types. SqliteTypeMapper.mapping cannot just use columnTypeName to determine the real SeaTunnel Data Type.

Check list

  • [ ] Code changed are covered with tests, or it does not need tests for reason:
  • [ ] If any new Jar binary package adding in your PR, please add License Notice according New License Guide
  • [ ] If necessary, please update the documentation to describe the new feature. https://github.com/apache/incubator-seatunnel/tree/dev/docs

nutsjian avatar Oct 13 '22 09:10 nutsjian

@EricJoy2048 thx, man. I fixed the e2e test. Please approve running workflows.

nutsjian avatar Oct 15 '22 15:10 nutsjian

Please add Source or Sink or Source & Sink in the pr title.

EricJoy2048 avatar Oct 20 '22 09:10 EricJoy2048

@EricJoy2048 Please help me run workflows again when you're not busy, thx. I have looked at the failed log, it seems that the doc has not been merged before.

nutsjian avatar Oct 20 '22 14:10 nutsjian

@EricJoy2048 please help me to rerun the CI workflows.

nutsjian avatar Nov 08 '22 06:11 nutsjian

Please add e2e in flink/spark e2e module. So that e2e can be start in CI. image

Hisoka-X avatar Nov 09 '22 03:11 Hisoka-X

Please add e2e in flink/spark e2e module. So that e2e can be start in CI. image

thx man, done. I have merged upstream dev, and add flink/spark connector-elasticsearch-e2e module.

nutsjian avatar Nov 11 '22 02:11 nutsjian

@EricJoy2048 I have add flink/spark elasticsearch e2e module in pom.xml, please help me rerun the CI workflows. thx.

nutsjian avatar Nov 11 '22 02:11 nutsjian

@EricJoy2048 please help me rerun ci workflows, if the unit test error has been resolved. thx.

2022-11-11T02:48:26.4091671Z [ERROR] Failed to execute goal on project connector-jdbc-spark-e2e: Could not resolve dependencies for project org.apache.seatunnel:connector-jdbc-spark-e2e:jar:2.1.3-SNAPSHOT: Failed to collect dependencies at org.testcontainers:postgresql:jar:1.17.3: Failed to read artifact descriptor for org.testcontainers:postgresql:jar:1.17.3: Could not transfer artifact org.testcontainers:postgresql:pom:1.17.3 from/to central (https://repo.maven.apache.org/maven2): transfer failed for https://repo.maven.apache.org/maven2/org/testcontainers/postgresql/1.17.3/postgresql-1.17.3.pom: Connection reset -> [Help 1]

nutsjian avatar Nov 15 '22 00:11 nutsjian

Please resolve conflict, Thanks!

Hisoka-X avatar Nov 15 '22 02:11 Hisoka-X

@Hisoka-X @EricJoy2048 conflict resolved, please help me rerun the CI workflows, thx.

nutsjian avatar Nov 15 '22 04:11 nutsjian

Please fix ci problem. Thanks!

Hisoka-X avatar Nov 19 '22 07:11 Hisoka-X