doris
doris copied to clipboard
apache
[Enhancement](BRPC)enlarge brpc_max_body_size to avoid connection killed
What problem does this PR solve?
In our env(180BE), the default brpc_max_body_size(3G) is not OK, which cause query/load failed. change it to 6G is OK now. so change the default brpc_max_body_size to 6G.
Issue Number: close #xxx
Related PR: #xxx
Problem Summary:
Release note
None
Check List (For Author)
-
Test
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason
-
Behavior changed:
- [ ] No.
- [ ] Yes.
-
Does this need documentation?
- [ ] No.
- [ ] Yes.
Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.
Please clearly describe your PR:
- What problem was fixed (it's best to include specific error reporting information). How it was fixed.
- Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
- What features were added. Why was this function added?
- Which code was refactored and why was this part of the code refactored?
- Which functions were optimized and what is the difference before and after the optimization?
PR approved by at least one committer and no changes requested.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
TPC-H: Total hot run time: 34129 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a2882e11377cf3fc759f081d1bf4611280453e13, data reload: false
------ Round 1 ----------------------------------
q1 17629 5233 5134 5134
q2 1938 313 189 189
q3 10353 1339 720 720
q4 10245 1001 515 515
q5 7600 2680 2297 2297
q6 185 165 133 133
q7 906 729 605 605
q8 9306 1288 1079 1079
q9 6843 5133 5100 5100
q10 6883 2362 1963 1963
q11 495 288 270 270
q12 344 351 226 226
q13 17762 3658 3084 3084
q14 228 220 213 213
q15 560 483 474 474
q16 434 427 374 374
q17 605 858 356 356
q18 7817 7367 7247 7247
q19 1713 954 555 555
q20 332 333 221 221
q21 3843 3190 2394 2394
q22 1021 1019 980 980
Total cold run time: 107042 ms
Total hot run time: 34129 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5161 5131 5140 5131
q2 240 326 224 224
q3 2193 2693 2312 2312
q4 1377 1765 1370 1370
q5 4232 4143 4346 4143
q6 212 172 132 132
q7 1975 1936 1736 1736
q8 2593 2542 2585 2542
q9 7111 7224 7092 7092
q10 3077 3275 2853 2853
q11 573 505 480 480
q12 705 774 636 636
q13 3567 3907 3267 3267
q14 291 297 281 281
q15 528 492 484 484
q16 440 477 440 440
q17 1147 1505 1364 1364
q18 7400 7235 7015 7015
q19 796 777 873 777
q20 1931 1943 1830 1830
q21 4808 4347 4287 4287
q22 1096 1022 992 992
Total cold run time: 51453 ms
Total hot run time: 49388 ms
TPC-DS: Total hot run time: 186008 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a2882e11377cf3fc759f081d1bf4611280453e13, data reload: false
query1 986 387 389 387
query2 6543 1854 1915 1854
query3 6739 226 229 226
query4 26638 23843 22982 22982
query5 4354 648 469 469
query6 312 218 215 215
query7 4619 508 295 295
query8 286 228 219 219
query9 8644 2639 2644 2639
query10 491 354 290 290
query11 15704 15124 14889 14889
query12 164 107 104 104
query13 1663 532 434 434
query14 9800 6381 6336 6336
query15 207 196 175 175
query16 7578 657 452 452
query17 1169 705 569 569
query18 1990 425 303 303
query19 193 179 162 162
query20 122 123 114 114
query21 211 137 111 111
query22 3940 4232 3844 3844
query23 34346 33089 33113 33089
query24 8366 2405 2412 2405
query25 521 451 398 398
query26 723 270 152 152
query27 2698 511 349 349
query28 4209 2136 2107 2107
query29 654 568 434 434
query30 289 233 197 197
query31 935 866 787 787
query32 71 69 65 65
query33 554 363 323 323
query34 824 853 532 532
query35 801 823 737 737
query36 975 1007 921 921
query37 119 103 75 75
query38 4169 4173 4016 4016
query39 1487 1442 1419 1419
query40 213 123 105 105
query41 65 60 60 60
query42 131 114 113 113
query43 540 537 480 480
query44 1376 830 861 830
query45 187 185 176 176
query46 888 1071 632 632
query47 1744 1793 1720 1720
query48 386 432 327 327
query49 704 482 403 403
query50 648 673 421 421
query51 4153 4177 4093 4093
query52 116 117 105 105
query53 231 260 185 185
query54 584 573 504 504
query55 85 99 86 86
query56 342 311 312 311
query57 1149 1202 1139 1139
query58 272 260 259 259
query59 2694 2758 2671 2671
query60 328 331 319 319
query61 133 122 127 122
query62 801 731 651 651
query63 233 192 192 192
query64 3063 1032 660 660
query65 4368 4224 4199 4199
query66 903 411 303 303
query67 15721 15645 15406 15406
query68 7800 883 525 525
query69 481 299 275 275
query70 1242 1130 1110 1110
query71 441 336 312 312
query72 5642 4805 4971 4805
query73 692 668 354 354
query74 9221 9258 8671 8671
query75 3462 3232 2729 2729
query76 3235 1191 766 766
query77 720 386 289 289
query78 9964 10136 9273 9273
query79 2043 834 595 595
query80 608 508 471 471
query81 473 266 227 227
query82 402 134 104 104
query83 250 255 241 241
query84 247 103 101 101
query85 813 355 322 322
query86 332 315 312 312
query87 4456 4371 4443 4371
query88 3752 2348 2330 2330
query89 387 332 304 304
query90 1961 220 218 218
query91 141 141 110 110
query92 73 63 59 59
query93 1350 952 584 584
query94 681 403 318 318
query95 399 313 308 308
query96 500 569 279 279
query97 2691 2752 2615 2615
query98 241 222 211 211
query99 1332 1428 1272 1272
Total cold run time: 272184 ms
Total hot run time: 186008 ms
ClickBench: Total hot run time: 29.49 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a2882e11377cf3fc759f081d1bf4611280453e13, data reload: false
query1 0.04 0.04 0.03
query2 0.07 0.04 0.03
query3 0.22 0.07 0.07
query4 1.62 0.10 0.10
query5 0.44 0.42 0.42
query6 1.18 0.65 0.67
query7 0.03 0.01 0.02
query8 0.04 0.04 0.04
query9 0.57 0.50 0.52
query10 0.56 0.56 0.57
query11 0.16 0.10 0.11
query12 0.14 0.11 0.11
query13 0.63 0.62 0.60
query14 0.80 0.83 0.82
query15 0.89 0.86 0.87
query16 0.38 0.38 0.39
query17 1.04 1.08 1.06
query18 0.22 0.20 0.21
query19 1.91 1.82 1.83
query20 0.01 0.01 0.01
query21 15.39 0.92 0.55
query22 0.75 1.16 0.76
query23 14.81 1.37 0.63
query24 7.25 1.44 0.66
query25 0.49 0.13 0.20
query26 0.62 0.17 0.13
query27 0.06 0.05 0.06
query28 9.47 0.91 0.46
query29 12.54 4.04 3.32
query30 0.25 0.09 0.06
query31 2.82 0.61 0.39
query32 3.24 0.56 0.48
query33 3.15 3.08 3.13
query34 16.09 5.37 4.82
query35 4.78 4.81 4.78
query36 0.68 0.50 0.49
query37 0.09 0.07 0.06
query38 0.05 0.04 0.04
query39 0.03 0.02 0.03
query40 0.17 0.15 0.14
query41 0.08 0.02 0.02
query42 0.04 0.02 0.03
query43 0.04 0.03 0.03
Total cold run time: 103.84 s
Total hot run time: 29.49 s
TPC-H: Total hot run time: 33967 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 422508cad92d88e5d54c1a8dda74843503c15d5d, data reload: false
------ Round 1 ----------------------------------
q1 17588 5184 5106 5106
q2 1951 279 178 178
q3 10509 1431 748 748
q4 10306 995 527 527
q5 8453 2400 2308 2308
q6 183 156 133 133
q7 891 751 603 603
q8 9313 1291 1069 1069
q9 6925 5111 5093 5093
q10 6876 2378 1950 1950
q11 463 300 283 283
q12 354 352 227 227
q13 17769 3742 3047 3047
q14 228 221 228 221
q15 532 486 480 480
q16 431 421 389 389
q17 598 869 360 360
q18 7533 7123 7177 7123
q19 1215 958 548 548
q20 335 353 221 221
q21 3913 2589 2405 2405
q22 1019 1005 948 948
Total cold run time: 107385 ms
Total hot run time: 33967 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5186 5121 5116 5116
q2 243 320 217 217
q3 2133 2682 2291 2291
q4 1436 1844 1308 1308
q5 4231 4579 4555 4555
q6 216 173 123 123
q7 2032 1911 1850 1850
q8 2665 2590 2537 2537
q9 7405 7247 7232 7232
q10 3173 3316 2829 2829
q11 566 546 498 498
q12 692 807 637 637
q13 3616 4012 3299 3299
q14 274 302 292 292
q15 517 468 470 468
q16 450 519 441 441
q17 1194 1599 1348 1348
q18 7915 7104 7092 7092
q19 800 736 849 736
q20 1980 1965 1814 1814
q21 4759 4345 4267 4267
q22 1056 1059 996 996
Total cold run time: 52539 ms
Total hot run time: 49946 ms
TPC-DS: Total hot run time: 186201 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 422508cad92d88e5d54c1a8dda74843503c15d5d, data reload: false
query1 1011 424 407 407
query2 6519 1769 1715 1715
query3 6743 212 211 211
query4 26327 23949 23339 23339
query5 4353 614 456 456
query6 304 223 208 208
query7 4635 529 287 287
query8 268 233 217 217
query9 8633 2624 2640 2624
query10 453 338 282 282
query11 16091 15183 15040 15040
query12 151 114 113 113
query13 1639 527 397 397
query14 8863 5690 5649 5649
query15 204 190 175 175
query16 7147 632 465 465
query17 1187 705 583 583
query18 1978 414 312 312
query19 193 198 164 164
query20 122 124 116 116
query21 215 129 112 112
query22 4146 4074 3937 3937
query23 34135 33456 32970 32970
query24 8558 2420 2412 2412
query25 540 473 442 442
query26 1239 274 153 153
query27 2761 542 362 362
query28 4326 2128 2106 2106
query29 831 567 435 435
query30 287 226 200 200
query31 934 871 767 767
query32 74 67 62 62
query33 571 369 313 313
query34 810 853 544 544
query35 789 820 761 761
query36 944 986 907 907
query37 111 107 75 75
query38 4157 4180 4162 4162
query39 1653 1450 1434 1434
query40 237 124 116 116
query41 70 62 61 61
query42 131 114 122 114
query43 494 519 458 458
query44 1352 839 829 829
query45 182 176 171 171
query46 853 1013 641 641
query47 1722 1806 1672 1672
query48 382 433 332 332
query49 768 524 414 414
query50 670 690 420 420
query51 4220 4339 4146 4146
query52 116 112 103 103
query53 233 257 193 193
query54 605 583 528 528
query55 86 82 85 82
query56 325 305 326 305
query57 1223 1182 1109 1109
query58 278 271 275 271
query59 2630 2713 2514 2514
query60 362 333 353 333
query61 130 124 122 122
query62 811 717 667 667
query63 225 186 194 186
query64 4385 1028 669 669
query65 4370 4260 4204 4204
query66 1152 404 312 312
query67 15767 15413 15373 15373
query68 8130 914 518 518
query69 477 385 281 281
query70 1213 1140 1126 1126
query71 462 334 299 299
query72 5800 4924 4955 4924
query73 741 665 354 354
query74 8975 9123 8928 8928
query75 3787 3215 2731 2731
query76 3622 1175 724 724
query77 789 414 299 299
query78 10870 10565 9620 9620
query79 2454 839 598 598
query80 636 515 451 451
query81 498 268 238 238
query82 455 125 98 98
query83 280 264 245 245
query84 364 105 85 85
query85 793 365 315 315
query86 387 301 266 266
query87 4492 4457 4318 4318
query88 3546 2262 2267 2262
query89 382 324 283 283
query90 1824 210 210 210
query91 139 146 116 116
query92 80 59 57 57
query93 1802 985 584 584
query94 672 402 307 307
query95 370 296 284 284
query96 493 559 280 280
query97 2767 2775 2666 2666
query98 238 209 209 209
query99 1459 1433 1266 1266
Total cold run time: 276678 ms
Total hot run time: 186201 ms
ClickBench: Total hot run time: 30.42 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 422508cad92d88e5d54c1a8dda74843503c15d5d, data reload: false
query1 0.04 0.03 0.04
query2 0.07 0.05 0.04
query3 0.25 0.08 0.07
query4 1.61 0.10 0.11
query5 0.43 0.45 0.42
query6 1.18 0.66 0.66
query7 0.03 0.02 0.02
query8 0.05 0.04 0.04
query9 0.61 0.52 0.53
query10 0.56 0.58 0.58
query11 0.16 0.11 0.11
query12 0.15 0.12 0.11
query13 0.62 0.61 0.61
query14 0.78 0.81 0.81
query15 0.90 0.87 0.87
query16 0.39 0.38 0.41
query17 1.10 1.06 1.05
query18 0.24 0.22 0.22
query19 1.99 1.94 1.83
query20 0.02 0.02 0.01
query21 15.41 0.93 0.55
query22 0.75 1.29 1.00
query23 14.70 1.39 0.66
query24 6.76 1.86 1.32
query25 0.51 0.11 0.09
query26 0.65 0.16 0.14
query27 0.07 0.06 0.05
query28 9.34 0.90 0.45
query29 12.57 4.04 3.31
query30 0.25 0.10 0.06
query31 2.83 0.58 0.38
query32 3.23 0.56 0.48
query33 3.05 3.05 3.08
query34 16.13 5.38 4.78
query35 4.84 4.87 4.80
query36 0.68 0.50 0.48
query37 0.09 0.07 0.07
query38 0.05 0.05 0.04
query39 0.03 0.02 0.03
query40 0.18 0.14 0.15
query41 0.08 0.02 0.03
query42 0.03 0.03 0.02
query43 0.04 0.03 0.03
Total cold run time: 103.45 s
Total hot run time: 30.42 s
BE UT Coverage Report
Increment line coverage :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 57.07% (15347/26892) |
| Line Coverage | 46.14% (139421/302190) |
| Region Coverage | 45.44% (70657/155487) |
| Branch Coverage | 40.22% (37317/92780) |
TPC-H: Total hot run time: 34465 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1f0a060cb57b0f43183f502478a1185df8803c23, data reload: false
------ Round 1 ----------------------------------
q1 17627 5244 5100 5100
q2 2048 311 215 215
q3 10236 1264 726 726
q4 10239 1040 529 529
q5 7552 2472 2374 2374
q6 186 172 140 140
q7 935 773 657 657
q8 9373 1380 1116 1116
q9 7134 5231 5187 5187
q10 6947 2418 1983 1983
q11 511 312 290 290
q12 372 367 235 235
q13 17789 3661 3055 3055
q14 242 232 219 219
q15 593 509 498 498
q16 441 432 375 375
q17 609 883 368 368
q18 8168 7208 7178 7178
q19 1702 966 566 566
q20 343 354 235 235
q21 4088 3316 2419 2419
q22 1073 1029 1000 1000
Total cold run time: 108208 ms
Total hot run time: 34465 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5293 5097 5139 5097
q2 269 340 230 230
q3 2204 2739 2323 2323
q4 1365 1764 1424 1424
q5 4354 4636 4610 4610
q6 216 173 136 136
q7 2111 1979 1914 1914
q8 2675 2791 2623 2623
q9 7411 7354 7282 7282
q10 3193 3299 2916 2916
q11 579 540 523 523
q12 672 868 644 644
q13 3550 3960 3299 3299
q14 290 336 308 308
q15 546 500 473 473
q16 471 510 460 460
q17 1462 1579 1390 1390
q18 7921 7733 7581 7581
q19 850 907 1014 907
q20 1975 2037 1912 1912
q21 4796 4304 4404 4304
q22 1073 1038 1028 1028
Total cold run time: 53276 ms
Total hot run time: 51384 ms
TPC-DS: Total hot run time: 185939 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1f0a060cb57b0f43183f502478a1185df8803c23, data reload: false
query1 1069 451 411 411
query2 6550 1739 1727 1727
query3 6760 231 221 221
query4 26269 23377 22901 22901
query5 4431 629 539 539
query6 327 232 226 226
query7 4665 509 314 314
query8 289 266 242 242
query9 8658 2893 2891 2891
query10 467 352 325 325
query11 15569 15080 14794 14794
query12 173 121 121 121
query13 1680 550 415 415
query14 8652 5881 5887 5881
query15 219 190 176 176
query16 7152 665 486 486
query17 963 763 632 632
query18 2028 446 359 359
query19 201 195 183 183
query20 135 126 124 124
query21 230 136 124 124
query22 4117 4233 3980 3980
query23 34055 32840 33510 32840
query24 8185 2429 2406 2406
query25 569 517 433 433
query26 1254 286 168 168
query27 2721 511 358 358
query28 4354 2306 2256 2256
query29 822 594 479 479
query30 294 230 200 200
query31 908 803 722 722
query32 84 83 81 81
query33 581 401 407 401
query34 814 845 519 519
query35 852 861 749 749
query36 969 1008 931 931
query37 128 111 92 92
query38 4123 4019 4098 4019
query39 1514 1446 1447 1446
query40 236 139 138 138
query41 72 58 58 58
query42 125 111 114 111
query43 514 534 483 483
query44 1347 867 864 864
query45 181 179 167 167
query46 873 1024 659 659
query47 1758 1790 1732 1732
query48 387 432 323 323
query49 741 505 406 406
query50 660 670 409 409
query51 4159 4252 4112 4112
query52 122 119 109 109
query53 257 271 196 196
query54 610 595 541 541
query55 92 92 93 92
query56 342 340 336 336
query57 1207 1196 1120 1120
query58 293 279 288 279
query59 2629 2725 2523 2523
query60 361 350 362 350
query61 188 162 158 158
query62 832 734 677 677
query63 243 195 197 195
query64 4536 1190 820 820
query65 4253 4194 4217 4194
query66 1161 444 347 347
query67 15332 15179 14973 14973
query68 7968 953 591 591
query69 504 342 288 288
query70 1223 1209 1168 1168
query71 575 347 320 320
query72 5899 5031 5216 5031
query73 690 658 356 356
query74 9342 9076 8667 8667
query75 3392 3093 2638 2638
query76 3214 1147 737 737
query77 567 405 338 338
query78 9701 9609 8939 8939
query79 2532 808 595 595
query80 691 592 511 511
query81 506 267 225 225
query82 326 141 111 111
query83 267 262 239 239
query84 307 114 97 97
query85 875 531 411 411
query86 380 317 303 303
query87 4300 4327 4229 4229
query88 3251 2208 2213 2208
query89 396 324 292 292
query90 1969 233 225 225
query91 160 165 130 130
query92 94 77 74 74
query93 2668 1000 651 651
query94 691 422 318 318
query95 415 348 330 330
query96 492 585 278 278
query97 2608 2735 2593 2593
query98 250 217 215 215
query99 1327 1437 1287 1287
Total cold run time: 273922 ms
Total hot run time: 185939 ms
ClickBench: Total hot run time: 29.83 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1f0a060cb57b0f43183f502478a1185df8803c23, data reload: false
query1 0.05 0.04 0.04
query2 0.08 0.05 0.05
query3 0.25 0.08 0.08
query4 1.60 0.11 0.12
query5 0.44 0.41 0.41
query6 1.18 0.64 0.65
query7 0.03 0.03 0.03
query8 0.05 0.04 0.04
query9 0.60 0.53 0.53
query10 0.57 0.58 0.58
query11 0.17 0.12 0.11
query12 0.15 0.12 0.12
query13 0.62 0.62 0.62
query14 0.80 0.84 0.85
query15 0.87 0.85 0.84
query16 0.39 0.41 0.39
query17 1.04 1.05 1.05
query18 0.21 0.23 0.20
query19 1.96 1.88 1.88
query20 0.02 0.01 0.02
query21 15.42 0.96 0.58
query22 0.79 1.21 0.62
query23 14.93 1.38 0.60
query24 6.53 2.20 0.65
query25 0.48 0.20 0.14
query26 0.52 0.20 0.14
query27 0.06 0.06 0.06
query28 9.25 0.90 0.43
query29 12.65 3.95 3.27
query30 0.28 0.14 0.11
query31 2.83 0.60 0.38
query32 3.25 0.56 0.49
query33 3.01 3.13 3.12
query34 15.98 5.49 4.88
query35 4.97 4.90 4.95
query36 0.69 0.51 0.50
query37 0.11 0.08 0.07
query38 0.06 0.04 0.05
query39 0.03 0.03 0.03
query40 0.18 0.16 0.15
query41 0.08 0.04 0.03
query42 0.04 0.03 0.03
query43 0.04 0.04 0.04
Total cold run time: 103.26 s
Total hot run time: 29.83 s
BE UT Coverage Report
Increment line coverage :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 51.88% (17230/33212) |
| Line Coverage | 37.28% (157212/421756) |
| Region Coverage | 31.93% (120048/376013) |
| Branch Coverage | 33.29% (52682/158232) |
BE Regression && UT Coverage Report
Increment line coverage 100% (0/0) :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 70.63% (23035/32612) |
| Line Coverage | 56.98% (240150/421480) |
| Region Coverage | 52.36% (199682/381400) |
| Branch Coverage | 54.04% (86000/159132) |
