doris
doris copied to clipboard
apache
[opt](compression) change default compression from lz4f to zstd
What problem does this PR solve?
Issue Number: close #xxx
Related PR: #xxx
Problem Summary:
Release note
None
Check List (For Author)
-
Test
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason
-
Behavior changed:
- [ ] No.
- [ ] Yes.
-
Does this need documentation?
- [ ] No.
- [ ] Yes.
Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.
Please clearly describe your PR:
- What problem was fixed (it's best to include specific error reporting information). How it was fixed.
- Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
- What features were added. Why was this function added?
- Which code was refactored and why was this part of the code refactored?
- Which functions were optimized and what is the difference before and after the optimization?
TPC-H: Total hot run time: 34959 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 99185708d439397e63e5371f2cb160360bc6ce82, data reload: false
------ Round 1 ----------------------------------
q1 17641 4171 4022 4022
q2 2053 345 241 241
q3 10172 1292 732 732
q4 10220 859 315 315
q5 7537 2165 1879 1879
q6 193 176 143 143
q7 996 857 711 711
q8 9382 1438 1214 1214
q9 7004 5365 5312 5312
q10 6851 2396 1954 1954
q11 511 326 313 313
q12 648 714 570 570
q13 17783 3670 3054 3054
q14 285 295 274 274
q15 589 510 511 510
q16 950 916 862 862
q17 736 828 482 482
q18 7601 7183 7008 7008
q19 1119 953 607 607
q20 404 357 248 248
q21 4217 3952 3536 3536
q22 1048 1006 972 972
Total cold run time: 107940 ms
Total hot run time: 34959 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4106 4036 4068 4036
q2 331 401 324 324
q3 2100 2646 2278 2278
q4 1324 1713 1266 1266
q5 4256 4618 4489 4489
q6 264 185 142 142
q7 2200 2021 1852 1852
q8 2672 2533 2551 2533
q9 7635 7553 7496 7496
q10 3054 3308 2827 2827
q11 579 508 480 480
q12 670 751 774 751
q13 3642 3938 3213 3213
q14 306 325 275 275
q15 568 523 510 510
q16 953 918 865 865
q17 1311 1501 1558 1501
q18 7732 7925 7631 7631
q19 886 834 901 834
q20 2103 2029 1833 1833
q21 4941 4241 4188 4188
q22 1107 1060 985 985
Total cold run time: 52740 ms
Total hot run time: 50309 ms
TPC-DS: Total hot run time: 181688 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 99185708d439397e63e5371f2cb160360bc6ce82, data reload: false
query5 4438 640 463 463
query6 334 235 223 223
query7 4215 468 287 287
query8 332 264 254 254
query9 8755 2581 2577 2577
query10 526 400 327 327
query11 15385 14971 14586 14586
query12 180 119 118 118
query13 1282 509 411 411
query14 6235 3263 2951 2951
query14_1 2892 2866 2914 2866
query15 209 202 193 193
query16 878 487 494 487
query17 1176 726 605 605
query18 2667 455 355 355
query19 232 234 217 217
query20 127 119 114 114
query21 220 154 132 132
query22 3949 3919 3935 3919
query23 16628 16177 15953 15953
query23_1 16159 16155 16146 16146
query24 7468 1652 1259 1259
query24_1 1253 1263 1257 1257
query25 580 498 446 446
query26 1250 281 176 176
query27 2742 479 318 318
query28 4454 2173 2157 2157
query29 821 578 473 473
query30 332 248 220 220
query31 837 706 632 632
query32 83 67 69 67
query33 556 351 305 305
query34 893 934 553 553
query35 792 829 736 736
query36 938 904 818 818
query37 135 95 77 77
query38 3880 3855 3776 3776
query39 756 733 740 733
query39_1 705 705 711 705
query40 226 141 122 122
query41 67 63 62 62
query42 107 103 104 103
query43 416 446 404 404
query44 1330 767 781 767
query45 191 184 185 184
query46 881 979 626 626
query47 1668 1727 1605 1605
query48 326 326 248 248
query49 649 423 354 354
query50 669 296 228 228
query51 3818 3826 3771 3771
query52 106 110 100 100
query53 315 356 294 294
query54 292 271 253 253
query55 82 73 73 73
query56 297 310 294 294
query57 1132 1141 1070 1070
query58 275 257 254 254
query59 2406 2425 2341 2341
query60 321 367 305 305
query61 157 159 154 154
query62 709 668 633 633
query63 336 296 299 296
query64 4966 1294 996 996
query65 4057 3980 3979 3979
query66 1413 446 318 318
query67 15270 15013 15070 15013
query68 8404 1017 752 752
query69 496 349 318 318
query70 1089 1013 943 943
query71 377 322 298 298
query72 6032 4996 5136 4996
query73 734 654 311 311
query74 8824 8911 8585 8585
query75 3618 3527 3174 3174
query76 3999 1149 741 741
query77 717 435 299 299
query78 9515 9901 8905 8905
query79 1265 879 624 624
query80 723 662 568 568
query81 511 272 242 242
query82 227 133 108 108
query83 275 259 241 241
query84 262 121 108 108
query85 912 521 469 469
query86 384 282 279 279
query87 4059 4112 3976 3976
query88 3227 2325 2297 2297
query89 466 444 398 398
query90 2180 163 155 155
query91 184 170 154 154
query92 80 74 66 66
query93 1161 967 585 585
query94 478 305 279 279
query95 590 329 362 329
query96 600 463 216 216
query97 2590 2658 2585 2585
query98 206 200 197 197
query99 1355 1300 1240 1240
Total cold run time: 263440 ms
Total hot run time: 181688 ms
ClickBench: Total hot run time: 27.76 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 99185708d439397e63e5371f2cb160360bc6ce82, data reload: false
query1 0.05 0.05 0.05
query2 0.10 0.05 0.05
query3 0.25 0.09 0.09
query4 1.60 0.10 0.11
query5 0.26 0.26 0.25
query6 1.18 0.64 0.63
query7 0.03 0.02 0.03
query8 0.05 0.04 0.05
query9 0.58 0.51 0.52
query10 0.55 0.57 0.55
query11 0.16 0.11 0.12
query12 0.14 0.12 0.12
query13 0.62 0.60 0.61
query14 0.98 1.00 0.99
query15 0.83 0.80 0.82
query16 0.40 0.42 0.40
query17 1.05 1.04 1.05
query18 0.24 0.22 0.23
query19 2.02 1.91 1.88
query20 0.02 0.02 0.01
query21 15.43 0.29 0.14
query22 4.86 0.05 0.06
query23 16.00 0.28 0.10
query24 1.73 0.48 0.71
query25 0.11 0.05 0.10
query26 0.14 0.14 0.13
query27 0.06 0.05 0.05
query28 4.84 1.25 1.03
query29 12.62 4.02 3.39
query30 0.28 0.14 0.13
query31 2.82 0.62 0.40
query32 3.24 0.55 0.46
query33 3.01 3.03 3.07
query34 17.02 5.25 4.53
query35 4.56 4.60 4.48
query36 0.67 0.50 0.50
query37 0.10 0.06 0.06
query38 0.07 0.04 0.04
query39 0.05 0.03 0.04
query40 0.17 0.14 0.13
query41 0.09 0.03 0.03
query42 0.05 0.03 0.02
query43 0.04 0.04 0.04
Total cold run time: 99.07 s
Total hot run time: 27.76 s
FE Regression Coverage Report
Increment line coverage 100.00% (1/1) :tada:
Increment coverage report
Complete coverage report
TPC-H: Total hot run time: 35335 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8c17297cf0b3ce7b50db0ded486533920709f293, data reload: false
------ Round 1 ----------------------------------
q1 17862 4195 4143 4143
q2 2359 347 239 239
q3 10758 1341 757 757
q4 10536 890 324 324
q5 7503 2169 1979 1979
q6 190 175 143 143
q7 1032 872 739 739
q8 9666 1423 1214 1214
q9 6972 5344 5350 5344
q10 7094 2396 1942 1942
q11 639 324 305 305
q12 681 727 585 585
q13 18282 3673 3075 3075
q14 298 293 276 276
q15 594 518 511 511
q16 691 686 635 635
q17 682 801 571 571
q18 7562 7062 7006 7006
q19 1207 952 598 598
q20 406 373 263 263
q21 4231 3918 3731 3731
q22 1050 1011 955 955
Total cold run time: 110295 ms
Total hot run time: 35335 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4161 4082 4053 4053
q2 344 403 325 325
q3 2100 2719 2269 2269
q4 1320 1727 1278 1278
q5 4765 4573 4698 4573
q6 230 179 129 129
q7 2009 1909 1831 1831
q8 2644 2604 2565 2565
q9 7503 7494 7605 7494
q10 3118 3278 2809 2809
q11 579 506 503 503
q12 712 724 668 668
q13 3414 3758 3278 3278
q14 308 316 286 286
q15 568 509 516 509
q16 654 706 680 680
q17 1262 1497 1489 1489
q18 7849 7832 7629 7629
q19 889 881 919 881
q20 2248 2049 1904 1904
q21 5011 4466 4271 4271
q22 1089 1021 987 987
Total cold run time: 52777 ms
Total hot run time: 50411 ms
TPC-DS: Total hot run time: 179098 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8c17297cf0b3ce7b50db0ded486533920709f293, data reload: false
query5 4704 637 484 484
query6 336 256 232 232
query7 4237 479 279 279
query8 313 270 250 250
query9 8770 2582 2585 2582
query10 478 382 342 342
query11 15337 15047 14546 14546
query12 177 120 116 116
query13 1272 552 410 410
query14 6142 3300 3071 3071
query14_1 2936 2989 2886 2886
query15 217 200 183 183
query16 981 497 460 460
query17 1190 728 622 622
query18 2440 460 379 379
query19 251 232 213 213
query20 132 119 115 115
query21 553 149 116 116
query22 4051 3985 3904 3904
query23 16658 16082 15969 15969
query23_1 15977 15953 16093 15953
query24 7432 1697 1262 1262
query24_1 1273 1268 1242 1242
query25 610 506 458 458
query26 1381 270 168 168
query27 2618 480 315 315
query28 4425 2178 2134 2134
query29 877 585 484 484
query30 361 247 221 221
query31 851 711 636 636
query32 80 70 72 70
query33 568 352 311 311
query34 914 942 568 568
query35 853 787 735 735
query36 871 903 796 796
query37 157 91 76 76
query38 2910 2948 2889 2889
query39 756 727 725 725
query39_1 719 703 691 691
query40 226 140 121 121
query41 72 70 64 64
query42 113 109 106 106
query43 449 452 407 407
query44 1381 744 732 732
query45 194 194 182 182
query46 896 1022 631 631
query47 1672 1658 1617 1617
query48 317 333 260 260
query49 717 438 359 359
query50 689 302 221 221
query51 3876 3838 3860 3838
query52 118 115 99 99
query53 342 357 306 306
query54 296 261 265 261
query55 86 76 75 75
query56 306 302 342 302
query57 1156 1162 1083 1083
query58 286 253 255 253
query59 2416 2490 2423 2423
query60 319 329 298 298
query61 168 169 165 165
query62 690 653 622 622
query63 338 305 311 305
query64 5022 1326 1039 1039
query65 4013 3934 3929 3929
query66 1468 442 315 315
query67 14945 14890 14919 14890
query68 8435 1027 728 728
query69 567 367 318 318
query70 1127 959 995 959
query71 379 307 290 290
query72 6204 5013 4947 4947
query73 678 592 307 307
query74 8534 8982 8531 8531
query75 3209 3119 2761 2761
query76 3955 1216 790 790
query77 685 414 292 292
query78 9543 9760 8918 8918
query79 1622 902 622 622
query80 738 659 563 563
query81 528 269 237 237
query82 366 140 112 112
query83 262 268 243 243
query84 257 119 102 102
query85 954 516 473 473
query86 380 296 294 294
query87 3143 3094 3062 3062
query88 3342 2291 2269 2269
query89 469 432 415 415
query90 2028 168 163 163
query91 178 173 149 149
query92 73 65 66 65
query93 1221 913 558 558
query94 499 302 273 273
query95 574 401 311 311
query96 615 482 211 211
query97 2269 2318 2239 2239
query98 214 197 205 197
query99 1342 1351 1188 1188
Total cold run time: 262418 ms
Total hot run time: 179098 ms
ClickBench: Total hot run time: 27.15 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8c17297cf0b3ce7b50db0ded486533920709f293, data reload: false
query1 0.05 0.04 0.04
query2 0.16 0.05 0.05
query3 0.26 0.09 0.09
query4 1.61 0.12 0.11
query5 0.27 0.26 0.26
query6 1.15 0.64 0.62
query7 0.04 0.03 0.02
query8 0.05 0.04 0.04
query9 0.59 0.51 0.52
query10 0.56 0.56 0.55
query11 0.19 0.11 0.11
query12 0.15 0.12 0.12
query13 0.62 0.60 0.60
query14 1.01 1.00 0.99
query15 0.82 0.80 0.81
query16 0.38 0.39 0.42
query17 1.04 1.10 1.04
query18 0.23 0.20 0.21
query19 1.97 1.75 1.81
query20 0.02 0.02 0.02
query21 15.47 0.29 0.14
query22 4.51 0.05 0.05
query23 16.08 0.30 0.10
query24 1.95 0.28 0.26
query25 0.08 0.06 0.05
query26 0.15 0.13 0.13
query27 0.05 0.06 0.04
query28 3.00 1.23 1.02
query29 12.64 4.03 3.18
query30 0.28 0.15 0.12
query31 2.81 0.63 0.40
query32 3.24 0.56 0.46
query33 2.98 2.99 3.03
query34 16.98 5.15 4.53
query35 4.57 4.56 4.51
query36 0.66 0.50 0.49
query37 0.13 0.07 0.07
query38 0.07 0.05 0.04
query39 0.07 0.03 0.03
query40 0.17 0.14 0.14
query41 0.11 0.04 0.03
query42 0.06 0.03 0.03
query43 0.05 0.03 0.04
Total cold run time: 97.28 s
Total hot run time: 27.15 s
FE Regression Coverage Report
Increment line coverage 100.00% (1/1) :tada:
Increment coverage report
Complete coverage report
PR approved by at least one committer and no changes requested.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}