doris icon indicating copy to clipboard operation
doris copied to clipboard

[fix](ES Catalog)Add array types support in esquery function (#36936)

Open qidaye opened this issue 1 year ago • 7 comments

backport #36936

qidaye avatar Jul 01 '24 02:07 qidaye

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar Jul 01 '24 02:07 doris-robot

run buildall

qidaye avatar Jul 01 '24 02:07 qidaye

run buildall

qidaye avatar Jul 01 '24 03:07 qidaye

TPC-H: Total hot run time: 50473 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bf132edfbf451ee34f37b84c5cd5baa8c0df7e78, data reload: false

------ Round 1 ----------------------------------
q1	17840	4492	4348	4348
q2	2076	167	146	146
q3	10457	2028	1946	1946
q4	10256	1449	1332	1332
q5	8583	3958	3914	3914
q6	230	123	149	123
q7	2026	1662	1652	1652
q8	9300	2760	2729	2729
q9	11007	10663	10608	10608
q10	8658	3568	3517	3517
q11	429	251	247	247
q12	468	303	308	303
q13	18370	3985	4093	3985
q14	350	323	330	323
q15	504	458	459	458
q16	689	578	574	574
q17	1149	981	964	964
q18	7251	6859	6986	6859
q19	1762	1664	1589	1589
q20	502	319	294	294
q21	4457	4129	4123	4123
q22	529	439	456	439
Total cold run time: 116893 ms
Total hot run time: 50473 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4328	4302	4343	4302
q2	322	221	225	221
q3	4170	4184	4138	4138
q4	2788	2748	2768	2748
q5	7248	7162	7183	7162
q6	242	118	116	116
q7	3261	2850	2826	2826
q8	4366	4477	4519	4477
q9	17452	17045	16859	16859
q10	4249	4272	4261	4261
q11	787	686	683	683
q12	1026	871	848	848
q13	7322	3765	3720	3720
q14	460	426	417	417
q15	503	450	461	450
q16	742	693	675	675
q17	3895	3929	3897	3897
q18	8861	8713	8822	8713
q19	1749	1712	1651	1651
q20	2422	2168	2112	2112
q21	8556	8514	8498	8498
q22	1074	935	943	935
Total cold run time: 85823 ms
Total hot run time: 79709 ms

doris-robot avatar Jul 01 '24 04:07 doris-robot

TPC-DS: Total hot run time: 205507 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bf132edfbf451ee34f37b84c5cd5baa8c0df7e78, data reload: false

query1	923	422	380	380
query2	6543	2842	2704	2704
query3	6925	211	201	201
query4	20087	18161	18035	18035
query5	19729	6496	6566	6496
query6	305	210	237	210
query7	4257	299	306	299
query8	448	448	440	440
query9	3144	2721	2629	2629
query10	414	302	287	287
query11	11360	10714	10752	10714
query12	133	74	74	74
query13	5594	699	706	699
query14	18204	13483	13785	13483
query15	355	248	251	248
query16	6446	293	270	270
query17	1477	1488	898	898
query18	2251	423	410	410
query19	207	158	161	158
query20	79	79	82	79
query21	191	94	92	92
query22	5243	5155	5084	5084
query23	32754	32119	32064	32064
query24	6824	6590	6542	6542
query25	545	455	437	437
query26	493	163	159	159
query27	1761	295	296	295
query28	6203	2364	2309	2309
query29	2963	2806	2746	2746
query30	244	167	169	167
query31	909	782	760	760
query32	67	67	62	62
query33	404	257	247	247
query34	849	473	483	473
query35	1132	929	916	916
query36	1310	1089	1175	1089
query37	87	62	60	60
query38	3062	2894	2981	2894
query39	1374	1340	1340	1340
query40	212	96	96	96
query41	47	46	43	43
query42	85	89	90	89
query43	755	682	743	682
query44	1118	716	720	716
query45	246	233	237	233
query46	1228	969	973	969
query47	1982	1750	1833	1750
query48	1014	710	697	697
query49	610	381	378	378
query50	872	620	611	611
query51	4781	4687	4659	4659
query52	83	76	80	76
query53	467	323	316	316
query54	2688	2490	2442	2442
query55	93	72	71	71
query56	225	225	212	212
query57	1133	1066	1080	1066
query58	218	204	202	202
query59	4238	3760	3995	3760
query60	214	202	216	202
query61	103	98	100	98
query62	821	474	453	453
query63	494	339	343	339
query64	2531	1589	1439	1439
query65	3652	3563	3553	3553
query66	750	386	384	384
query67	15977	16114	18071	16114
query68	9632	679	660	660
query69	577	343	355	343
query70	1656	1428	1419	1419
query71	407	304	335	304
query72	6781	3534	3514	3514
query73	729	322	328	322
query74	6240	5834	5975	5834
query75	5289	3747	3796	3747
query76	6226	1158	1182	1158
query77	1052	259	262	259
query78	13572	12446	12037	12037
query79	8864	657	664	657
query80	805	401	405	401
query81	483	233	239	233
query82	1416	101	98	98
query83	165	133	131	131
query84	259	71	70	70
query85	727	329	322	322
query86	343	301	287	287
query87	3280	3051	3089	3051
query88	4743	2332	2367	2332
query89	443	302	284	284
query90	1892	212	210	210
query91	171	142	138	138
query92	60	50	53	50
query93	5997	586	621	586
query94	659	209	216	209
query95	1092	1054	1038	1038
query96	647	333	330	330
query97	6591	6337	6473	6337
query98	180	181	180	180
query99	2812	868	866	866
Total cold run time: 315723 ms
Total hot run time: 205507 ms

doris-robot avatar Jul 01 '24 04:07 doris-robot

ClickBench: Total hot run time: 30.72 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bf132edfbf451ee34f37b84c5cd5baa8c0df7e78, data reload: false

query1	0.03	0.02	0.02
query2	0.07	0.02	0.02
query3	0.24	0.04	0.04
query4	1.79	0.06	0.06
query5	0.53	0.52	0.52
query6	1.23	0.63	0.62
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.52	0.48	0.50
query10	0.54	0.53	0.54
query11	0.12	0.09	0.08
query12	0.12	0.09	0.09
query13	0.61	0.60	0.62
query14	0.78	0.80	0.79
query15	0.77	0.75	0.75
query16	0.36	0.38	0.37
query17	1.01	1.01	1.03
query18	0.22	0.25	0.23
query19	1.94	1.84	1.85
query20	0.01	0.02	0.02
query21	15.46	0.55	0.56
query22	2.00	2.53	1.31
query23	16.71	1.04	1.08
query24	7.61	1.16	1.28
query25	0.37	0.12	0.06
query26	0.82	0.15	0.16
query27	0.03	0.04	0.04
query28	5.13	0.72	0.70
query29	12.60	2.26	2.28
query30	0.63	0.49	0.51
query31	2.81	0.38	0.37
query32	3.40	0.50	0.50
query33	3.12	3.14	3.07
query34	15.26	4.82	4.81
query35	4.86	4.85	4.86
query36	1.10	1.03	1.01
query37	0.06	0.05	0.04
query38	0.03	0.02	0.03
query39	0.02	0.01	0.02
query40	0.16	0.14	0.14
query41	0.07	0.02	0.01
query42	0.02	0.01	0.01
query43	0.02	0.02	0.02
Total cold run time: 103.23 s
Total hot run time: 30.72 s

doris-robot avatar Jul 01 '24 04:07 doris-robot

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit bf132edfbf451ee34f37b84c5cd5baa8c0df7e78 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.1 seconds inserted 10000000 Rows, about 473K ops/s

doris-robot avatar Jul 01 '24 04:07 doris-robot