[Feature][Connector-V2][Milvus] Support Milvus source & sink
Purpose of this pull request
Support Milvus source & sink.
Does this PR introduce any user-facing change?
How was this patch tested?
Check list
- [ ] If any new Jar binary package adding in your PR, please add License Notice according New License Guide
- [x] If necessary, please update the documentation to describe the new feature. https://github.com/apache/seatunnel/tree/dev/docs
- [x] If you are contributing the connector code, please check that the following files are updated:
- Update change log that in connector document. For more details you can refer to connector-v2
- Update plugin-mapping.properties and add new connector information in it
- Update the pom file of seatunnel-dist
- [ ] Update the
release-note.
cc @liugddx as well
Hi @Thomas-HuWei , thanks for your contribute! Please follow the guide to open github action on your fork repository. https://github.com/apache/seatunnel/pull/7060/checks?check_run_id=26644733039
https://github.com/apache/seatunnel/pull/7060/checks?check_run_id=26644733039
I've done. Next what should I do?
https://github.com/apache/seatunnel/pull/7060/checks?check_run_id=26644733039
I've done. Next what should I do?
push an emtpy commit.
Please format the code by executing mvn spotless:apply
Please format the code by executing
mvn spotless:apply
I've do spotless, but it seems that docs can't pass the ci. And do you have any contact ways? I want to chat something with you about seatunnel support vector database.
Please format the code by executing
mvn spotless:applyI've do spotless, but it seems that docs can't pass the ci. And do you have any contact ways? I want to chat something with you about seatunnel support vector database.
Our operations staff has WeChat, and you can join the WeChat group through him. wechat id seatunnel1
Please fix ci.
Please fix ci.
Why spotless check Milvus.md?
How can I fix it? Delete these docs?
Please fix ci.
Why spotless check Milvus.md?
How can I fix it? Delete these docs?
Please use mvn spotless:apply to format doc before commit.
@Hisoka-X I had fix my code ci problem, but there still exist ci error.
@Hisoka-X I had fix my code ci problem, but there still exist ci error.
Please retry the failed ci
@Hisoka-X
These two job, I have retry many times, but it still fail.
Seem like the engine-k8s-it failed reason not related with this PR. Never mind.
Seem like the
engine-k8s-itfailed reason not related with this PR. Never mind.
Fixed by #7101
@Hisoka-X @liugddx
I have add e2e test, but it runs fail.
Do you know how to solve this problem?
Implement SupportMultiTableSink to support concurrent writes
https://github.com/apache/seatunnel/blob/57e5627e89e870f26c1b0774cc225eaabe7f3c9a/seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/sink/JdbcSink.java#L63
https://github.com/apache/seatunnel/blob/57e5627e89e870f26c1b0774cc225eaabe7f3c9a/seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/sink/JdbcSinkWriter.java#L46
https://github.com/apache/seatunnel/blob/57e5627e89e870f26c1b0774cc225eaabe7f3c9a/seatunnel-api/src/main/java/org/apache/seatunnel/api/sink/SinkCommonOptions.java#L27
MultiTable metadata placeholders
https://github.com/apache/seatunnel/blob/57e5627e89e870f26c1b0774cc225eaabe7f3c9a/seatunnel-connectors-v2/connector-paimon/src/main/java/org/apache/seatunnel/connectors/seatunnel/paimon/sink/PaimonSinkFactory.java#L77
please link to https://github.com/apache/seatunnel/pull/7158

