doris
doris copied to clipboard
Published
20 hours ago •
apache
apache
[feature](load) support compressed JSON format data for broker load
Proposed changes
Issue Number: close #xxx
We have a large amount of data stored in HDFS in GZIP-compressed JSON format, and currently Doris does not support loading compressed JSON format data.
Upgrade points:
- Upgraded the NewJsonReader (in new_json_reader.cpp) to construct the _decompressor during its initialization based on the compression type specified during load, and then use the _decompressor to initialize the LineReader.
- Refactored the _create_decompressor() method of CsvReader by extracting the code that constructs the _decompressor based on _file_compress_type or _file_format_type. This code was moved to the Decompressor class as a factory method create_decompressor(). This allows the code to be reused by NewJsonReader.
Further comments
If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR
TPC-H: Total hot run time: 36930 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 834208075b96e771d962516481be8e3c6f5fff4f, data reload: false
------ Round 1 ----------------------------------
q1 17665 4483 4418 4418
q2 2034 143 138 138
q3 10590 916 938 916
q4 4650 764 706 706
q5 7684 2849 2820 2820
q6 182 120 120 120
q7 1142 728 734 728
q8 9261 1980 2008 1980
q9 7242 6339 6357 6339
q10 8109 2437 2443 2437
q11 420 213 212 212
q12 773 267 280 267
q13 18027 3326 3341 3326
q14 272 250 252 250
q15 535 499 489 489
q16 487 403 410 403
q17 932 474 543 474
q18 6762 5901 5865 5865
q19 1537 1460 1371 1371
q20 623 335 329 329
q21 6700 3116 3035 3035
q22 813 307 308 307
Total cold run time: 106440 ms
Total hot run time: 36930 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4593 4496 4352 4352
q2 326 233 231 231
q3 3013 2827 2817 2817
q4 1914 1712 1637 1637
q5 5185 5266 5245 5245
q6 192 114 117 114
q7 2166 1710 1725 1710
q8 3099 3278 3275 3275
q9 8294 8291 8245 8245
q10 5818 3598 3573 3573
q11 542 455 475 455
q12 745 589 585 585
q13 11464 3143 3124 3124
q14 291 247 259 247
q15 533 487 501 487
q16 496 460 496 460
q17 1825 1610 1702 1610
q18 7948 7655 7471 7471
q19 7206 1512 1539 1512
q20 2141 1923 1908 1908
q21 4642 4685 4547 4547
q22 549 483 517 483
Total cold run time: 72982 ms
Total hot run time: 54088 ms
TeamCity be ut coverage result: Function Coverage: 36.14% (8625/23863) Line Coverage: 28.21% (70545/250085) Region Coverage: 27.21% (36408/133787) Branch Coverage: 24.00% (18645/77692) Coverage Report: http://coverage.selectdb-in.cc/coverage/834208075b96e771d962516481be8e3c6f5fff4f_834208075b96e771d962516481be8e3c6f5fff4f/report/index.html
TPC-DS: Total hot run time: 175336 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 834208075b96e771d962516481be8e3c6f5fff4f, data reload: false
query1 930 337 335 335
query2 6565 1863 1912 1863
query3 6705 213 202 202
query4 31695 22066 22025 22025
query5 4332 375 411 375
query6 250 170 169 169
query7 4607 281 283 281
query8 255 177 177 177
query9 9288 2333 2312 2312
query10 413 228 213 213
query11 18984 15468 15504 15468
query12 133 80 75 75
query13 1621 436 408 408
query14 9064 7119 6872 6872
query15 243 187 178 178
query16 8150 251 238 238
query17 1816 543 504 504
query18 2099 272 269 269
query19 360 145 142 142
query20 81 77 79 77
query21 195 129 133 129
query22 4825 4685 4594 4594
query23 31745 30832 30632 30632
query24 8632 2812 2799 2799
query25 1152 351 348 348
query26 2067 148 159 148
query27 2668 326 308 308
query28 6672 1863 1862 1862
query29 856 583 593 583
query30 280 135 143 135
query31 906 712 716 712
query32 94 51 52 51
query33 533 227 227 227
query34 806 453 462 453
query35 868 758 726 726
query36 1040 937 939 937
query37 94 56 60 56
query38 3194 3126 3173 3126
query39 1313 1266 1259 1259
query40 184 93 92 92
query41 38 36 34 34
query42 93 88 90 88
query43 514 457 443 443
query44 1061 683 696 683
query45 190 181 177 177
query46 1043 648 652 648
query47 1598 1512 1443 1443
query48 437 351 347 347
query49 1071 288 286 286
query50 742 374 367 367
query51 5269 5185 5199 5185
query52 104 85 83 83
query53 330 269 267 267
query54 246 215 217 215
query55 90 75 81 75
query56 213 203 200 200
query57 980 904 933 904
query58 205 173 188 173
query59 2533 2221 2392 2221
query60 232 212 219 212
query61 82 83 88 83
query62 631 365 363 363
query63 295 270 265 265
query64 4740 3788 3572 3572
query65 3259 3247 3224 3224
query66 812 307 300 300
query67 14389 14322 13984 13984
query68 5448 531 536 531
query69 488 337 324 324
query70 1269 1187 1189 1187
query71 352 249 242 242
query72 6263 2859 2672 2672
query73 695 314 325 314
query74 6525 6274 6205 6205
query75 3070 2316 2339 2316
query76 3015 907 916 907
query77 374 228 224 224
query78 9185 8798 8771 8771
query79 2127 484 497 484
query80 985 353 332 332
query81 525 196 194 194
query82 701 80 75 75
query83 228 123 121 121
query84 233 80 80 80
query85 2095 349 321 321
query86 487 315 291 291
query87 3348 3258 3186 3186
query88 3675 2318 2343 2318
query89 438 370 353 353
query90 1907 166 163 163
query91 152 120 122 120
query92 58 41 45 41
query93 2469 505 450 450
query94 1271 176 177 176
query95 478 7933 367 367
query96 582 272 292 272
query97 4217 4149 4163 4149
query98 223 210 206 206
query99 978 749 742 742
Total cold run time: 280773 ms
Total hot run time: 175336 ms
ClickBench: Total hot run time: 30.71 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 834208075b96e771d962516481be8e3c6f5fff4f, data reload: false
query1 0.04 0.03 0.04
query2 0.05 0.02 0.02
query3 0.23 0.07 0.06
query4 1.68 0.10 0.10
query5 0.53 0.52 0.52
query6 1.21 0.65 0.67
query7 0.02 0.02 0.02
query8 0.03 0.02 0.02
query9 0.58 0.51 0.51
query10 0.56 0.55 0.54
query11 0.11 0.09 0.08
query12 0.10 0.08 0.09
query13 0.61 0.62 0.61
query14 0.80 0.80 0.80
query15 0.80 0.77 0.78
query16 0.36 0.41 0.39
query17 1.04 1.02 0.97
query18 0.22 0.28 0.24
query19 1.88 1.76 1.82
query20 0.01 0.01 0.01
query21 15.40 0.56 0.56
query22 2.56 2.47 2.12
query23 17.45 0.81 0.76
query24 2.41 1.38 0.45
query25 0.29 0.22 0.14
query26 0.52 0.14 0.13
query27 0.05 0.04 0.05
query28 12.24 0.83 0.85
query29 12.47 3.14 3.20
query30 0.64 0.51 0.56
query31 2.79 0.36 0.37
query32 3.33 0.48 0.48
query33 3.21 3.17 3.24
query34 15.94 4.23 4.35
query35 4.36 4.33 4.30
query36 1.13 1.06 1.05
query37 0.06 0.05 0.05
query38 0.04 0.02 0.03
query39 0.02 0.01 0.01
query40 0.16 0.13 0.14
query41 0.07 0.02 0.02
query42 0.03 0.01 0.02
query43 0.03 0.02 0.03
Total cold run time: 106.06 s
Total hot run time: 30.71 s
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Load test result on commit 834208075b96e771d962516481be8e3c6f5fff4f with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 60 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 13.6 seconds inserted 10000000 Rows, about 735K ops/s
TPC-H: Total hot run time: 37253 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d9c945f8c15dd55e2bcd904c15325a0143b90d7c, data reload: false
------ Round 1 ----------------------------------
q1 17764 4555 4591 4555
q2 2483 147 134 134
q3 11542 930 940 930
q4 5172 809 715 715
q5 8013 2856 2901 2856
q6 183 120 121 120
q7 1168 736 726 726
q8 9268 2021 2000 2000
q9 7286 6384 6365 6365
q10 8128 2429 2462 2429
q11 424 201 211 201
q12 765 264 269 264
q13 18032 3321 3316 3316
q14 278 247 249 247
q15 540 495 493 493
q16 479 408 414 408
q17 936 500 484 484
q18 6836 5956 6029 5956
q19 1589 1405 1384 1384
q20 615 345 327 327
q21 6935 3055 3089 3055
q22 799 310 288 288
Total cold run time: 109235 ms
Total hot run time: 37253 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4547 4411 4464 4411
q2 346 235 237 235
q3 2985 2866 2849 2849
q4 1877 1606 1617 1606
q5 5232 5242 5254 5242
q6 188 112 111 111
q7 2165 1746 1770 1746
q8 3096 3209 3221 3209
q9 8419 8374 8362 8362
q10 5830 3584 3537 3537
q11 538 458 472 458
q12 738 570 575 570
q13 14788 3126 3055 3055
q14 287 247 271 247
q15 526 492 490 490
q16 515 479 468 468
q17 1886 1662 1687 1662
q18 7864 7809 7748 7748
q19 1684 1498 1519 1498
q20 2140 1940 1923 1923
q21 4771 4533 4544 4533
q22 543 468 485 468
Total cold run time: 70965 ms
Total hot run time: 54428 ms
TeamCity be ut coverage result: Function Coverage: 36.19% (8628/23841) Line Coverage: 28.21% (70561/250147) Region Coverage: 27.22% (36423/133801) Branch Coverage: 24.00% (18655/77724) Coverage Report: http://coverage.selectdb-in.cc/coverage/d9c945f8c15dd55e2bcd904c15325a0143b90d7c_d9c945f8c15dd55e2bcd904c15325a0143b90d7c/report/index.html
TPC-DS: Total hot run time: 174429 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d9c945f8c15dd55e2bcd904c15325a0143b90d7c, data reload: false
query1 934 342 339 339
query2 6533 1899 1927 1899
query3 6724 215 207 207
query4 31759 22062 22018 22018
query5 4260 359 352 352
query6 250 169 166 166
query7 4598 288 279 279
query8 237 170 174 170
query9 9126 2289 2272 2272
query10 415 230 220 220
query11 17117 15362 15335 15335
query12 128 76 78 76
query13 1619 410 410 410
query14 9383 6981 7221 6981
query15 290 180 181 180
query16 8141 260 253 253
query17 2007 565 504 504
query18 2121 270 261 261
query19 363 138 140 138
query20 85 74 81 74
query21 194 123 119 119
query22 5060 4751 4643 4643
query23 31413 29986 29961 29961
query24 10692 2749 2749 2749
query25 568 351 341 341
query26 1325 149 145 145
query27 2934 306 295 295
query28 7604 1845 1836 1836
query29 879 611 596 596
query30 285 129 143 129
query31 892 694 699 694
query32 88 53 49 49
query33 740 229 224 224
query34 1076 465 483 465
query35 865 731 777 731
query36 995 927 924 924
query37 110 56 53 53
query38 3269 3088 3123 3088
query39 1291 1257 1235 1235
query40 181 97 92 92
query41 36 40 35 35
query42 94 91 90 90
query43 524 480 452 452
query44 1118 698 710 698
query45 193 182 173 173
query46 1060 674 653 653
query47 1597 1535 1391 1391
query48 427 356 341 341
query49 1082 282 290 282
query50 771 371 372 371
query51 5239 5148 5221 5148
query52 91 92 83 83
query53 332 258 270 258
query54 271 211 220 211
query55 79 80 78 78
query56 225 196 205 196
query57 1014 903 902 902
query58 202 190 180 180
query59 2480 2231 2229 2229
query60 239 214 212 212
query61 87 84 90 84
query62 625 358 360 358
query63 312 276 276 276
query64 5270 3482 3675 3482
query65 3261 3256 3214 3214
query66 944 311 306 306
query67 14285 14242 14183 14183
query68 4459 549 537 537
query69 460 341 335 335
query70 1213 1241 1194 1194
query71 325 239 250 239
query72 6244 2847 2688 2688
query73 691 326 327 326
query74 6601 6263 6203 6203
query75 3123 2323 2306 2306
query76 2536 935 931 931
query77 340 237 230 230
query78 9090 8829 8602 8602
query79 3027 495 483 483
query80 2123 349 343 343
query81 534 197 197 197
query82 881 84 83 83
query83 247 135 127 127
query84 283 84 74 74
query85 2260 362 329 329
query86 492 310 322 310
query87 3371 3288 3268 3268
query88 4134 2317 2317 2317
query89 441 357 365 357
query90 2025 161 164 161
query91 153 126 123 123
query92 58 44 42 42
query93 4207 512 460 460
query94 1298 176 179 176
query95 479 364 367 364
query96 593 263 271 263
query97 4239 4109 4122 4109
query98 224 209 189 189
query99 1121 715 674 674
Total cold run time: 285681 ms
Total hot run time: 174429 ms
ClickBench: Total hot run time: 30.85 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d9c945f8c15dd55e2bcd904c15325a0143b90d7c, data reload: false
query1 0.04 0.03 0.03
query2 0.05 0.03 0.02
query3 0.23 0.06 0.07
query4 1.67 0.10 0.10
query5 0.54 0.51 0.52
query6 1.21 0.66 0.65
query7 0.02 0.02 0.01
query8 0.04 0.03 0.02
query9 0.56 0.50 0.51
query10 0.58 0.56 0.56
query11 0.11 0.08 0.08
query12 0.11 0.10 0.09
query13 0.61 0.60 0.61
query14 0.78 0.81 0.79
query15 0.80 0.79 0.77
query16 0.39 0.37 0.40
query17 1.06 1.04 1.03
query18 0.24 0.26 0.25
query19 1.89 1.76 1.78
query20 0.02 0.01 0.01
query21 15.43 0.57 0.56
query22 2.78 2.51 1.90
query23 17.22 0.95 0.79
query24 2.62 0.66 0.89
query25 0.35 0.15 0.13
query26 0.46 0.15 0.14
query27 0.08 0.06 0.05
query28 12.48 0.85 0.83
query29 12.62 3.17 3.19
query30 0.70 0.52 0.50
query31 2.78 0.35 0.34
query32 3.37 0.48 0.49
query33 3.20 3.20 3.21
query34 15.80 4.31 4.30
query35 4.30 4.28 4.31
query36 1.11 1.06 1.06
query37 0.06 0.05 0.05
query38 0.04 0.03 0.03
query39 0.02 0.01 0.02
query40 0.16 0.12 0.13
query41 0.07 0.01 0.02
query42 0.03 0.01 0.02
query43 0.03 0.02 0.02
Total cold run time: 106.66 s
Total hot run time: 30.85 s
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Load test result on commit d9c945f8c15dd55e2bcd904c15325a0143b90d7c with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 14.3 seconds inserted 10000000 Rows, about 699K ops/s
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
pls add test cases for this feature
Thank you for your code review. I've encountered some data diff while doing large-scale data load tests, and it seems that there are issues with the scan range generation on the FE side. I will need another two to three days to fix this.
TeamCity be ut coverage result: Function Coverage: 35.42% (8553/24148) Line Coverage: 27.19% (69405/255246) Region Coverage: 26.41% (36004/136349) Branch Coverage: 23.25% (18395/79104) Coverage Report: http://coverage.selectdb-in.cc/coverage/b9c6e6932637b4a9ee1b4755fc3358ac5f5cdaf7_b9c6e6932637b4a9ee1b4755fc3358ac5f5cdaf7/report/index.html
TPC-H: Total hot run time: 37574 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e88c551ea8966d2aec80fd5f6cff5aa5f39f7c14, data reload: false
------ Round 1 ----------------------------------
q1 17739 4004 4005 4004
q2 2020 149 139 139
q3 10561 954 924 924
q4 4669 941 921 921
q5 7612 2871 2975 2871
q6 175 128 123 123
q7 1285 830 793 793
q8 9473 2023 2058 2023
q9 7177 6449 6397 6397
q10 8189 2564 2527 2527
q11 433 221 224 221
q12 737 316 300 300
q13 17971 2959 2917 2917
q14 280 249 250 249
q15 483 449 430 430
q16 487 394 402 394
q17 934 806 786 786
q18 6831 5900 5873 5873
q19 1557 1514 1503 1503
q20 557 275 275 275
q21 7556 3617 3681 3617
q22 796 297 287 287
Total cold run time: 107522 ms
Total hot run time: 37574 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4063 3979 3965 3965
q2 318 222 236 222
q3 2942 2918 2888 2888
q4 1820 1802 1757 1757
q5 5229 5256 5218 5218
q6 203 115 118 115
q7 2247 1802 1802 1802
q8 3200 3260 3258 3258
q9 8529 8472 8514 8472
q10 6114 3764 3713 3713
q11 529 435 438 435
q12 708 524 530 524
q13 11579 2759 2809 2759
q14 265 252 266 252
q15 465 442 434 434
q16 460 398 399 398
q17 1673 1649 1665 1649
q18 7786 7412 7253 7253
q19 2897 1612 1585 1585
q20 1983 1742 1736 1736
q21 4892 4810 4732 4732
q22 522 470 462 462
Total cold run time: 68424 ms
Total hot run time: 53629 ms
TPC-DS: Total hot run time: 178003 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e88c551ea8966d2aec80fd5f6cff5aa5f39f7c14, data reload: false
query1 917 362 338 338
query2 7310 2046 1984 1984
query3 6704 218 213 213
query4 27852 20999 21089 20999
query5 4288 754 1241 754
query6 265 178 177 177
query7 4624 305 306 305
query8 248 200 179 179
query9 8375 2187 2184 2184
query10 435 225 251 225
query11 15096 14346 14251 14251
query12 144 93 93 93
query13 1649 433 431 431
query14 8941 7070 7247 7070
query15 233 180 186 180
query16 7244 261 276 261
query17 1014 569 561 561
query18 1916 276 273 273
query19 206 164 166 164
query20 96 93 93 93
query21 198 132 130 130
query22 4628 4472 4438 4438
query23 31906 30608 30304 30304
query24 11884 3087 3042 3042
query25 708 410 404 404
query26 1906 164 168 164
query27 2920 368 372 368
query28 6681 1819 1782 1782
query29 1311 611 608 608
query30 315 148 149 148
query31 943 748 740 740
query32 106 66 59 59
query33 752 272 269 269
query34 950 456 485 456
query35 929 814 796 796
query36 947 821 814 814
query37 282 70 74 70
query38 3272 3180 3136 3136
query39 1405 1496 1512 1496
query40 303 117 118 117
query41 65 55 54 54
query42 116 107 103 103
query43 437 404 398 398
query44 1077 734 715 715
query45 207 196 196 196
query46 1045 779 768 768
query47 1641 1569 1548 1548
query48 425 356 377 356
query49 1203 352 356 352
query50 787 391 389 389
query51 6777 6711 6692 6692
query52 108 108 117 108
query53 355 288 283 283
query54 327 248 253 248
query55 92 87 84 84
query56 251 231 238 231
query57 1085 988 1003 988
query58 255 217 224 217
query59 2361 2180 2269 2180
query60 265 274 287 274
query61 116 114 118 114
query62 662 432 412 412
query63 304 280 288 280
query64 6293 3385 3192 3192
query65 3017 3023 2986 2986
query66 1474 351 351 351
query67 15216 14373 14565 14373
query68 12223 568 591 568
query69 694 379 374 374
query70 1359 1091 1109 1091
query71 626 285 273 273
query72 9999 2680 2485 2485
query73 2147 343 343 343
query74 7175 6975 6838 6838
query75 6700 2692 2663 2663
query76 8008 1087 1174 1087
query77 925 258 260 258
query78 10329 9593 9606 9593
query79 9358 512 517 512
query80 834 384 381 381
query81 475 207 216 207
query82 254 96 89 89
query83 246 145 148 145
query84 284 77 77 77
query85 1177 334 325 325
query86 363 294 294 294
query87 3481 3260 3261 3260
query88 3179 2386 2350 2350
query89 532 358 362 358
query90 2282 174 173 173
query91 155 127 133 127
query92 58 50 47 47
query93 3669 522 515 515
query94 1460 185 190 185
query95 440 341 353 341
query96 594 276 276 276
query97 4011 3848 3870 3848
query98 228 226 200 200
query99 1060 777 752 752
Total cold run time: 310189 ms
Total hot run time: 178003 ms
ClickBench: Total hot run time: 30.43 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e88c551ea8966d2aec80fd5f6cff5aa5f39f7c14, data reload: false
query1 0.04 0.03 0.03
query2 0.05 0.03 0.03
query3 0.23 0.06 0.06
query4 1.69 0.10 0.09
query5 0.50 0.49 0.51
query6 1.41 0.66 0.66
query7 0.02 0.01 0.01
query8 0.03 0.03 0.03
query9 0.57 0.52 0.54
query10 0.57 0.57 0.57
query11 0.12 0.10 0.10
query12 0.13 0.10 0.10
query13 0.57 0.56 0.57
query14 0.74 0.74 0.76
query15 0.81 0.80 0.80
query16 0.36 0.38 0.39
query17 0.97 0.96 0.96
query18 0.26 0.25 0.26
query19 1.81 1.67 1.71
query20 0.02 0.01 0.01
query21 15.86 0.68 0.54
query22 2.81 4.79 2.10
query23 17.35 1.00 1.02
query24 2.11 0.39 0.38
query25 0.28 0.13 0.04
query26 0.16 0.14 0.14
query27 0.04 0.03 0.03
query28 12.35 0.83 0.83
query29 12.58 3.25 3.19
query30 0.61 0.53 0.58
query31 2.79 0.33 0.35
query32 3.39 0.44 0.43
query33 2.94 2.88 2.87
query34 15.50 4.34 4.38
query35 4.34 4.32 4.33
query36 1.08 1.01 1.02
query37 0.07 0.05 0.05
query38 0.04 0.03 0.03
query39 0.02 0.02 0.02
query40 0.16 0.14 0.14
query41 0.07 0.02 0.01
query42 0.03 0.02 0.02
query43 0.02 0.02 0.03
Total cold run time: 105.5 s
Total hot run time: 30.43 s
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Load test result on commit e88c551ea8966d2aec80fd5f6cff5aa5f39f7c14 with default session variables
Stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc: 60 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 18.3 seconds inserted 10000000 Rows, about 546K ops/s
TeamCity be ut coverage result: Function Coverage: 35.42% (8555/24154) Line Coverage: 27.18% (69417/255423) Region Coverage: 26.40% (36019/136438) Branch Coverage: 23.24% (18409/79206) Coverage Report: http://coverage.selectdb-in.cc/coverage/e88c551ea8966d2aec80fd5f6cff5aa5f39f7c14_e88c551ea8966d2aec80fd5f6cff5aa5f39f7c14/report/index.html
PR approved by at least one committer and no changes requested.