doris
doris copied to clipboard
[fix](ES Catalog)Add array types support in esquery function (#36936)
backport #36936
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR
Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.
run buildall
run buildall
TPC-H: Total hot run time: 50473 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bf132edfbf451ee34f37b84c5cd5baa8c0df7e78, data reload: false
------ Round 1 ----------------------------------
q1 17840 4492 4348 4348
q2 2076 167 146 146
q3 10457 2028 1946 1946
q4 10256 1449 1332 1332
q5 8583 3958 3914 3914
q6 230 123 149 123
q7 2026 1662 1652 1652
q8 9300 2760 2729 2729
q9 11007 10663 10608 10608
q10 8658 3568 3517 3517
q11 429 251 247 247
q12 468 303 308 303
q13 18370 3985 4093 3985
q14 350 323 330 323
q15 504 458 459 458
q16 689 578 574 574
q17 1149 981 964 964
q18 7251 6859 6986 6859
q19 1762 1664 1589 1589
q20 502 319 294 294
q21 4457 4129 4123 4123
q22 529 439 456 439
Total cold run time: 116893 ms
Total hot run time: 50473 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4328 4302 4343 4302
q2 322 221 225 221
q3 4170 4184 4138 4138
q4 2788 2748 2768 2748
q5 7248 7162 7183 7162
q6 242 118 116 116
q7 3261 2850 2826 2826
q8 4366 4477 4519 4477
q9 17452 17045 16859 16859
q10 4249 4272 4261 4261
q11 787 686 683 683
q12 1026 871 848 848
q13 7322 3765 3720 3720
q14 460 426 417 417
q15 503 450 461 450
q16 742 693 675 675
q17 3895 3929 3897 3897
q18 8861 8713 8822 8713
q19 1749 1712 1651 1651
q20 2422 2168 2112 2112
q21 8556 8514 8498 8498
q22 1074 935 943 935
Total cold run time: 85823 ms
Total hot run time: 79709 ms
TPC-DS: Total hot run time: 205507 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bf132edfbf451ee34f37b84c5cd5baa8c0df7e78, data reload: false
query1 923 422 380 380
query2 6543 2842 2704 2704
query3 6925 211 201 201
query4 20087 18161 18035 18035
query5 19729 6496 6566 6496
query6 305 210 237 210
query7 4257 299 306 299
query8 448 448 440 440
query9 3144 2721 2629 2629
query10 414 302 287 287
query11 11360 10714 10752 10714
query12 133 74 74 74
query13 5594 699 706 699
query14 18204 13483 13785 13483
query15 355 248 251 248
query16 6446 293 270 270
query17 1477 1488 898 898
query18 2251 423 410 410
query19 207 158 161 158
query20 79 79 82 79
query21 191 94 92 92
query22 5243 5155 5084 5084
query23 32754 32119 32064 32064
query24 6824 6590 6542 6542
query25 545 455 437 437
query26 493 163 159 159
query27 1761 295 296 295
query28 6203 2364 2309 2309
query29 2963 2806 2746 2746
query30 244 167 169 167
query31 909 782 760 760
query32 67 67 62 62
query33 404 257 247 247
query34 849 473 483 473
query35 1132 929 916 916
query36 1310 1089 1175 1089
query37 87 62 60 60
query38 3062 2894 2981 2894
query39 1374 1340 1340 1340
query40 212 96 96 96
query41 47 46 43 43
query42 85 89 90 89
query43 755 682 743 682
query44 1118 716 720 716
query45 246 233 237 233
query46 1228 969 973 969
query47 1982 1750 1833 1750
query48 1014 710 697 697
query49 610 381 378 378
query50 872 620 611 611
query51 4781 4687 4659 4659
query52 83 76 80 76
query53 467 323 316 316
query54 2688 2490 2442 2442
query55 93 72 71 71
query56 225 225 212 212
query57 1133 1066 1080 1066
query58 218 204 202 202
query59 4238 3760 3995 3760
query60 214 202 216 202
query61 103 98 100 98
query62 821 474 453 453
query63 494 339 343 339
query64 2531 1589 1439 1439
query65 3652 3563 3553 3553
query66 750 386 384 384
query67 15977 16114 18071 16114
query68 9632 679 660 660
query69 577 343 355 343
query70 1656 1428 1419 1419
query71 407 304 335 304
query72 6781 3534 3514 3514
query73 729 322 328 322
query74 6240 5834 5975 5834
query75 5289 3747 3796 3747
query76 6226 1158 1182 1158
query77 1052 259 262 259
query78 13572 12446 12037 12037
query79 8864 657 664 657
query80 805 401 405 401
query81 483 233 239 233
query82 1416 101 98 98
query83 165 133 131 131
query84 259 71 70 70
query85 727 329 322 322
query86 343 301 287 287
query87 3280 3051 3089 3051
query88 4743 2332 2367 2332
query89 443 302 284 284
query90 1892 212 210 210
query91 171 142 138 138
query92 60 50 53 50
query93 5997 586 621 586
query94 659 209 216 209
query95 1092 1054 1038 1038
query96 647 333 330 330
query97 6591 6337 6473 6337
query98 180 181 180 180
query99 2812 868 866 866
Total cold run time: 315723 ms
Total hot run time: 205507 ms
ClickBench: Total hot run time: 30.72 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bf132edfbf451ee34f37b84c5cd5baa8c0df7e78, data reload: false
query1 0.03 0.02 0.02
query2 0.07 0.02 0.02
query3 0.24 0.04 0.04
query4 1.79 0.06 0.06
query5 0.53 0.52 0.52
query6 1.23 0.63 0.62
query7 0.02 0.01 0.01
query8 0.03 0.02 0.02
query9 0.52 0.48 0.50
query10 0.54 0.53 0.54
query11 0.12 0.09 0.08
query12 0.12 0.09 0.09
query13 0.61 0.60 0.62
query14 0.78 0.80 0.79
query15 0.77 0.75 0.75
query16 0.36 0.38 0.37
query17 1.01 1.01 1.03
query18 0.22 0.25 0.23
query19 1.94 1.84 1.85
query20 0.01 0.02 0.02
query21 15.46 0.55 0.56
query22 2.00 2.53 1.31
query23 16.71 1.04 1.08
query24 7.61 1.16 1.28
query25 0.37 0.12 0.06
query26 0.82 0.15 0.16
query27 0.03 0.04 0.04
query28 5.13 0.72 0.70
query29 12.60 2.26 2.28
query30 0.63 0.49 0.51
query31 2.81 0.38 0.37
query32 3.40 0.50 0.50
query33 3.12 3.14 3.07
query34 15.26 4.82 4.81
query35 4.86 4.85 4.86
query36 1.10 1.03 1.01
query37 0.06 0.05 0.04
query38 0.03 0.02 0.03
query39 0.02 0.01 0.02
query40 0.16 0.14 0.14
query41 0.07 0.02 0.01
query42 0.02 0.01 0.01
query43 0.02 0.02 0.02
Total cold run time: 103.23 s
Total hot run time: 30.72 s
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Load test result on commit bf132edfbf451ee34f37b84c5cd5baa8c0df7e78 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 21.1 seconds inserted 10000000 Rows, about 473K ops/s