doris icon indicating copy to clipboard operation
doris copied to clipboard

[dependency](fe)Dependency Upgrade

Open CalvinKirs opened this issue 2 years ago • 4 comments

  • Upgrade log4j to 2.X

    • binding log4j version to 2.18.0
    • used log4j-1.2-api complete smooth upgrade
  • Upgrade filerupload to 1.5

  • Upgrade commons-io to 2.7

  • Upgrade commons-compress to 1.22

  • Upgrade gson to 2.8.9

  • Upgrade guava to 30.0-jre

  • Binding jackson version to 2.14.2

  • Upgrade netty-all to 4.1.89.final

  • Upgrade protobuf to 3.21.12

  • Upgrade kafka-clints to 3.4.0

  • Upgrade calcite version to 1.33.0

  • Upgrade aws-java-sdk to 1.12.302

  • Upgrade hadoop to 3.3.4

  • Upgrade zookeeper to 3.4.14

  • Binding tomcat-embed-core to 8.5.86

  • Use hive-exec-core as a hive dependency, add the missing jar-hive-serde separately

  • Basic public dependencies are extracted to parent dependencies

  • Use jackson uniformly as the basic json tool

  • Remove springloaded, spring-boot-devtools has the same functionality

  • Modify the spark-related dependency scope to provide, which should be provided at runtime

Proposed changes

Issue Number: close #xxx

Problem summary

Describe your changes.

Checklist(Required)

  • [ ] Does it affect the original behavior
  • [ ] Has unit tests been added
  • [ ] Has document been added or modified
  • [ ] Does it need to update dependencies
  • [ ] Is this PR support rollback (If NO, please explain WHY)

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

CalvinKirs avatar Mar 03 '23 02:03 CalvinKirs

status-WIP todo:

  • UT builds pass, waiting for IT.
  • LICENSE update

CalvinKirs avatar Mar 03 '23 03:03 CalvinKirs

run buildall

CalvinKirs avatar Mar 03 '23 06:03 CalvinKirs

TeamCity pipeline, clickbench performance test result: the sum of best hot time: 34.44 seconds stream load tsv: 470 seconds loaded 74807831229 Bytes, about 151 MB/s stream load json: 39 seconds loaded 2358488459 Bytes, about 57 MB/s stream load orc: 75 seconds loaded 1101869774 Bytes, about 14 MB/s stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230308041331_clickbench_pr_110549.html

hello-stephen avatar Mar 03 '23 07:03 hello-stephen

run p0

CalvinKirs avatar Mar 03 '23 08:03 CalvinKirs

run buildall

CalvinKirs avatar Mar 06 '23 01:03 CalvinKirs

run buildall

CalvinKirs avatar Mar 07 '23 08:03 CalvinKirs

run buildall

CalvinKirs avatar Mar 08 '23 03:03 CalvinKirs