doris
doris copied to clipboard
[dependency](fe)Dependency Upgrade
-
Upgrade log4j to 2.X
- binding log4j version to 2.18.0
- used log4j-1.2-api complete smooth upgrade
-
Upgrade filerupload to 1.5
-
Upgrade commons-io to 2.7
-
Upgrade commons-compress to 1.22
-
Upgrade gson to 2.8.9
-
Upgrade guava to 30.0-jre
-
Binding jackson version to 2.14.2
-
Upgrade netty-all to 4.1.89.final
-
Upgrade protobuf to 3.21.12
-
Upgrade kafka-clints to 3.4.0
-
Upgrade calcite version to 1.33.0
-
Upgrade aws-java-sdk to 1.12.302
-
Upgrade hadoop to 3.3.4
-
Upgrade zookeeper to 3.4.14
-
Binding tomcat-embed-core to 8.5.86
-
Use hive-exec-core as a hive dependency, add the missing jar-hive-serde separately
-
Basic public dependencies are extracted to parent dependencies
-
Use jackson uniformly as the basic json tool
-
Remove springloaded, spring-boot-devtools has the same functionality
-
Modify the spark-related dependency scope to provide, which should be provided at runtime
Proposed changes
Issue Number: close #xxx
Problem summary
Describe your changes.
Checklist(Required)
- [ ] Does it affect the original behavior
- [ ] Has unit tests been added
- [ ] Has document been added or modified
- [ ] Does it need to update dependencies
- [ ] Is this PR support rollback (If NO, please explain WHY)
Further comments
If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...
status-WIP todo:
- UT builds pass, waiting for IT.
- LICENSE update
run buildall
TeamCity pipeline, clickbench performance test result: the sum of best hot time: 34.44 seconds stream load tsv: 470 seconds loaded 74807831229 Bytes, about 151 MB/s stream load json: 39 seconds loaded 2358488459 Bytes, about 57 MB/s stream load orc: 75 seconds loaded 1101869774 Bytes, about 14 MB/s stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230308041331_clickbench_pr_110549.html
run p0
run buildall
run buildall
run buildall