seatunnel
seatunnel copied to clipboard
[Improve][Core] Optimize package logic
Move jdbc driver jars into plugins
Purpose of this pull request
Check list
- [ ] Code changed are covered with tests, or it does not need tests for reason:
- [ ] If any new Jar binary package adding in your PR, please add License Notice according New License Guide
- [ ] If necessary, please update the documentation to describe the new feature. https://github.com/apache/seatunnel/tree/dev/docs
- [ ] If you are contributing the connector code, please check that the following files are updated:
- Update change log that in connector document. For more details you can refer to connector-v2
- Update plugin-mapping.properties and add new connector information in it
- Update the pom file of seatunnel-dist
- [ ] Update the
release-note
.
@Hisoka-X PTAL
Hi, can you explain why want to change this?
Hi, can you explain why want to change this?
When we pakcage manually, all jdbc driver jars will be put in lib/, every seatunnel job before start it will load all jars in lib, so if any jobs doesn't need these dependencies, it maybe casue jar conflict. This change only infect the package manually. e.g. : mvn clean package -Pci
. But we have another concern about it because all ci steps do not be executed. This change whether infect the jdbc connectors we don't a clearly result.
so if any jobs doesn't need these dependencies, it maybe casue jar conflict
Seem this PR doesn't fix this error. All driver also would be loaded when submit a job if put it in plugin/lib.