doris icon indicating copy to clipboard operation
doris copied to clipboard

[feat](Nereids): Put the Child with Least Row Count in the First Position of Intersect

Open keanji-x opened this issue 10 months ago • 11 comments

Proposed changes

In this pull request, we optimize the ordering of children in the Intersect operator to improve query performance. The proposed change is to place the child with the least row count in the first position of the Intersect operator.

The rationale behind this optimization is that the Intersect operator works by first evaluating the leftmost child and then iterating through the results of the other children to find matching rows. By placing the child with the least row count first, we can minimize the number of iterations required to find the matching rows, thereby reducing the overall execution time of the query.

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

keanji-x avatar Apr 29 '24 08:04 keanji-x

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar Apr 29 '24 08:04 doris-robot

run buildall

keanji-x avatar Apr 29 '24 08:04 keanji-x

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar Apr 29 '24 08:04 github-actions[bot]

PR approved by anyone and no changes requested.

github-actions[bot] avatar Apr 29 '24 08:04 github-actions[bot]

TPC-H: Total hot run time: 40396 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 08130bb286fdd6fc96ef7991562592930a1e9625, data reload: false

------ Round 1 ----------------------------------
q1	17873	4396	4312	4312
q2	2642	195	194	194
q3	11270	1292	1222	1222
q4	10500	960	862	862
q5	7660	2734	2688	2688
q6	215	134	134	134
q7	1060	611	601	601
q8	9261	2136	2092	2092
q9	9326	6625	6591	6591
q10	8656	3756	3764	3756
q11	450	245	240	240
q12	387	219	223	219
q13	17767	2930	2907	2907
q14	266	223	232	223
q15	506	467	460	460
q16	468	387	376	376
q17	966	705	747	705
q18	8081	7448	7482	7448
q19	1665	1542	1495	1495
q20	653	311	310	310
q21	5076	3286	3332	3286
q22	335	275	283	275
Total cold run time: 115083 ms
Total hot run time: 40396 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4252	4185	4193	4185
q2	384	269	266	266
q3	3034	2728	2762	2728
q4	1877	1597	1587	1587
q5	5285	5263	5323	5263
q6	204	121	123	121
q7	2232	1863	1874	1863
q8	3195	3326	3342	3326
q9	8526	8552	8485	8485
q10	3892	3658	3704	3658
q11	585	495	480	480
q12	747	592	592	592
q13	17335	2963	2962	2962
q14	303	295	281	281
q15	516	466	483	466
q16	480	415	413	413
q17	1780	1493	1475	1475
q18	7634	7396	7379	7379
q19	1614	1527	1521	1521
q20	1946	1741	1775	1741
q21	4746	4714	4756	4714
q22	549	480	486	480
Total cold run time: 71116 ms
Total hot run time: 53986 ms

doris-robot avatar Apr 29 '24 08:04 doris-robot

TPC-DS: Total hot run time: 185132 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 08130bb286fdd6fc96ef7991562592930a1e9625, data reload: false

query1	908	371	347	347
query2	6431	2332	2366	2332
query3	6655	212	215	212
query4	23536	21197	21216	21197
query5	4176	421	427	421
query6	273	183	174	174
query7	4591	292	285	285
query8	251	186	184	184
query9	8462	2319	2295	2295
query10	441	247	247	247
query11	14694	14096	14123	14096
query12	130	90	84	84
query13	1639	352	359	352
query14	10604	7447	7399	7399
query15	237	172	174	172
query16	7917	262	262	262
query17	1848	562	537	537
query18	1949	269	264	264
query19	197	144	145	144
query20	90	89	87	87
query21	197	123	124	123
query22	5010	4916	4854	4854
query23	33609	33190	33092	33092
query24	11357	2928	2847	2847
query25	646	370	378	370
query26	1616	148	145	145
query27	2931	313	319	313
query28	7482	1992	1977	1977
query29	999	592	591	591
query30	301	148	150	148
query31	979	740	748	740
query32	89	50	53	50
query33	739	243	244	243
query34	1070	470	472	470
query35	817	675	652	652
query36	1055	895	902	895
query37	138	66	66	66
query38	2883	2736	2742	2736
query39	1593	1534	1552	1534
query40	276	123	127	123
query41	45	42	40	40
query42	106	96	100	96
query43	560	541	536	536
query44	1200	732	740	732
query45	298	252	256	252
query46	1080	757	703	703
query47	1950	1876	1869	1869
query48	356	292	286	286
query49	1145	404	389	389
query50	766	377	385	377
query51	6732	6698	6702	6698
query52	98	94	91	91
query53	349	276	273	273
query54	323	227	230	227
query55	84	73	74	73
query56	246	219	222	219
query57	1209	1103	1138	1103
query58	231	199	200	199
query59	3541	3004	3226	3004
query60	264	248	235	235
query61	89	86	86	86
query62	652	454	450	450
query63	305	275	274	274
query64	9516	7090	7091	7090
query65	3154	3017	3038	3017
query66	1397	357	342	342
query67	15509	15139	14924	14924
query68	5208	526	524	524
query69	480	300	301	300
query70	1143	1142	1111	1111
query71	403	275	265	265
query72	7622	2655	2413	2413
query73	692	321	323	321
query74	6573	6174	6102	6102
query75	3414	2715	2686	2686
query76	3396	966	939	939
query77	408	265	261	261
query78	11085	10241	10345	10241
query79	4121	530	526	526
query80	1782	426	426	426
query81	529	227	221	221
query82	931	94	96	94
query83	270	174	174	174
query84	267	92	83	83
query85	2136	265	265	265
query86	514	302	293	293
query87	3290	3043	3058	3043
query88	4435	2346	2312	2312
query89	499	378	367	367
query90	2016	186	177	177
query91	122	94	95	94
query92	58	47	46	46
query93	5089	518	491	491
query94	1255	183	178	178
query95	392	299	304	299
query96	597	260	258	258
query97	3135	2941	2922	2922
query98	249	218	215	215
query99	1231	840	855	840
Total cold run time: 293363 ms
Total hot run time: 185132 ms

doris-robot avatar Apr 29 '24 08:04 doris-robot

run buildall

keanji-x avatar Apr 29 '24 09:04 keanji-x

TPC-DS: Total hot run time: 187780 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f12b2c889dadcbed1906e1a6ccdfc8471ff0d496, data reload: false

query1	906	356	343	343
query2	6404	2432	2416	2416
query3	6653	212	217	212
query4	23705	21829	21998	21829
query5	3720	436	419	419
query6	260	198	201	198
query7	4539	303	293	293
query8	240	203	198	198
query9	8475	2382	2403	2382
query10	406	250	257	250
query11	15301	14870	14815	14815
query12	121	85	88	85
query13	1621	364	367	364
query14	9843	8314	8392	8314
query15	250	165	167	165
query16	8221	257	261	257
query17	1781	569	553	553
query18	2106	284	268	268
query19	322	150	154	150
query20	93	85	85	85
query21	187	129	122	122
query22	5030	4869	4872	4869
query23	33878	32914	33239	32914
query24	10850	3068	2919	2919
query25	612	376	375	375
query26	1122	154	151	151
query27	2866	313	338	313
query28	7487	1985	1999	1985
query29	883	616	602	602
query30	250	152	152	152
query31	956	730	729	729
query32	93	54	53	53
query33	746	253	250	250
query34	1042	467	493	467
query35	805	666	667	666
query36	1025	893	924	893
query37	132	65	73	65
query38	2890	2747	2751	2747
query39	1596	1534	1623	1534
query40	209	129	146	129
query41	42	40	40	40
query42	108	97	95	95
query43	591	535	552	535
query44	1205	730	737	730
query45	280	262	264	262
query46	1077	736	725	725
query47	1960	1877	1871	1871
query48	378	301	298	298
query49	859	402	414	402
query50	757	383	392	383
query51	6906	6792	6865	6792
query52	107	88	88	88
query53	345	283	280	280
query54	323	234	238	234
query55	76	71	71	71
query56	255	227	219	219
query57	1241	1115	1126	1115
query58	222	194	195	194
query59	3480	3399	3069	3069
query60	258	234	231	231
query61	89	87	86	86
query62	663	472	446	446
query63	309	285	281	281
query64	9555	7205	7133	7133
query65	3062	3018	3068	3018
query66	1406	357	332	332
query67	15754	14988	14852	14852
query68	9401	541	551	541
query69	543	314	307	307
query70	1366	1034	1041	1034
query71	510	280	278	278
query72	8197	2618	2431	2431
query73	1606	323	322	322
query74	6604	6038	6094	6038
query75	4671	2692	2627	2627
query76	5687	985	913	913
query77	668	269	266	266
query78	11070	10276	10237	10237
query79	12782	525	535	525
query80	1960	469	443	443
query81	497	226	223	223
query82	691	90	90	90
query83	207	169	163	163
query84	259	80	80	80
query85	1490	274	269	269
query86	406	299	296	296
query87	3305	3072	3075	3072
query88	5127	2358	2331	2331
query89	550	373	372	372
query90	2054	189	188	188
query91	130	96	97	96
query92	59	48	48	48
query93	7078	508	499	499
query94	1295	182	184	182
query95	393	299	301	299
query96	615	270	263	263
query97	3111	2983	2941	2941
query98	233	224	217	217
query99	1257	876	884	876
Total cold run time: 312756 ms
Total hot run time: 187780 ms

doris-robot avatar Apr 29 '24 10:04 doris-robot

run buildall

keanji-x avatar Apr 30 '24 02:04 keanji-x

TPC-H: Total hot run time: 39712 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cde91a609eec0d3cd640ebdcbe1799f6b7b719c5, data reload: false

------ Round 1 ----------------------------------
q1	17949	4810	4334	4334
q2	2785	187	191	187
q3	11458	1151	1189	1151
q4	10342	760	752	752
q5	7534	2677	2670	2670
q6	218	130	132	130
q7	1018	582	573	573
q8	9231	2073	2020	2020
q9	9012	6517	6426	6426
q10	8973	3709	3726	3709
q11	471	237	241	237
q12	484	209	215	209
q13	18744	2960	2960	2960
q14	254	221	220	220
q15	503	478	482	478
q16	519	383	374	374
q17	948	730	737	730
q18	8003	7436	7313	7313
q19	3905	1537	1529	1529
q20	661	316	307	307
q21	5003	3130	3849	3130
q22	339	273	279	273
Total cold run time: 118354 ms
Total hot run time: 39712 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4356	4193	4167	4167
q2	372	266	273	266
q3	2932	2729	2744	2729
q4	1850	1590	1579	1579
q5	5312	5290	5292	5290
q6	208	124	122	122
q7	2234	1911	1900	1900
q8	3165	3332	3308	3308
q9	8436	8434	8404	8404
q10	3840	3652	3682	3652
q11	573	479	494	479
q12	762	585	613	585
q13	16518	2961	2982	2961
q14	288	274	272	272
q15	520	461	474	461
q16	465	419	419	419
q17	1755	1512	1470	1470
q18	7825	7562	7368	7368
q19	1646	1545	1495	1495
q20	1932	1758	1788	1758
q21	4877	4731	4701	4701
q22	553	478	488	478
Total cold run time: 70419 ms
Total hot run time: 53864 ms

doris-robot avatar Apr 30 '24 03:04 doris-robot

TPC-DS: Total hot run time: 185754 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cde91a609eec0d3cd640ebdcbe1799f6b7b719c5, data reload: false

query1	927	367	344	344
query2	6462	2436	2418	2418
query3	6649	204	203	203
query4	22905	21159	21113	21113
query5	4152	425	440	425
query6	286	184	204	184
query7	4594	300	304	300
query8	242	188	196	188
query9	8546	2287	2277	2277
query10	422	246	250	246
query11	14747	14142	14170	14142
query12	144	87	87	87
query13	1666	385	398	385
query14	10480	7443	8155	7443
query15	278	164	163	163
query16	8180	252	274	252
query17	1845	558	543	543
query18	2127	287	266	266
query19	222	149	152	149
query20	92	88	83	83
query21	201	131	126	126
query22	5045	4803	4808	4803
query23	33676	33269	33128	33128
query24	10718	2838	2888	2838
query25	619	377	372	372
query26	1594	153	151	151
query27	2949	324	326	324
query28	7406	1964	1974	1964
query29	959	608	609	608
query30	299	152	155	152
query31	1004	754	717	717
query32	102	53	56	53
query33	757	262	250	250
query34	1049	480	476	476
query35	812	675	656	656
query36	1062	955	904	904
query37	140	70	73	70
query38	2927	2749	2747	2747
query39	1591	1529	1529	1529
query40	282	129	128	128
query41	46	43	42	42
query42	103	107	103	103
query43	574	519	510	510
query44	1224	725	741	725
query45	275	253	260	253
query46	1070	741	702	702
query47	1937	1830	1885	1830
query48	366	298	304	298
query49	1189	428	446	428
query50	772	404	407	404
query51	6759	6924	6739	6739
query52	106	87	97	87
query53	347	280	280	280
query54	342	248	249	248
query55	76	73	74	73
query56	247	249	235	235
query57	1227	1134	1141	1134
query58	241	207	206	206
query59	3383	3311	3227	3227
query60	287	252	248	248
query61	109	107	104	104
query62	690	468	440	440
query63	315	285	282	282
query64	9672	7145	7157	7145
query65	3113	3049	3058	3049
query66	1368	346	336	336
query67	15475	14961	15302	14961
query68	9391	541	538	538
query69	596	314	323	314
query70	1369	1123	1107	1107
query71	502	267	268	267
query72	8461	2534	2358	2358
query73	1662	317	324	317
query74	6601	6118	6025	6025
query75	4490	2639	2702	2639
query76	5811	1004	947	947
query77	640	266	265	265
query78	10989	10201	10238	10201
query79	10855	532	530	530
query80	1959	446	444	444
query81	505	221	221	221
query82	237	94	93	93
query83	230	170	169	169
query84	267	82	88	82
query85	1127	271	265	265
query86	344	292	275	275
query87	3284	3111	3043	3043
query88	5079	2400	2393	2393
query89	511	385	374	374
query90	2020	188	188	188
query91	132	99	101	99
query92	58	48	48	48
query93	6375	511	503	503
query94	1390	187	183	183
query95	397	308	301	301
query96	611	275	262	262
query97	3144	2957	2926	2926
query98	246	223	213	213
query99	1106	911	868	868
Total cold run time: 309860 ms
Total hot run time: 185754 ms

doris-robot avatar Apr 30 '24 03:04 doris-robot

run buildall

keanji-x avatar May 06 '24 03:05 keanji-x

TPC-H: Total hot run time: 40581 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 265f3d98c13b8b50a73b70d176bcefbf36a03f4b, data reload: false

------ Round 1 ----------------------------------
q1	18051	4293	4206	4206
q2	2013	192	196	192
q3	10534	1231	1247	1231
q4	11955	731	763	731
q5	7552	2707	2749	2707
q6	215	132	140	132
q7	1043	588	590	588
q8	9490	2128	2091	2091
q9	9529	6746	6625	6625
q10	8987	3674	3682	3674
q11	458	251	237	237
q12	475	212	210	210
q13	17774	2977	2926	2926
q14	250	230	223	223
q15	499	460	465	460
q16	497	376	369	369
q17	955	708	751	708
q18	7994	7379	7355	7355
q19	1610	1517	1492	1492
q20	641	311	301	301
q21	5006	3851	3976	3851
q22	344	276	272	272
Total cold run time: 115872 ms
Total hot run time: 40581 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4279	4208	4135	4135
q2	367	265	265	265
q3	2939	2703	2678	2678
q4	1833	1563	1584	1563
q5	5273	5276	5227	5227
q6	209	126	123	123
q7	2219	1872	1904	1872
q8	3154	3348	3332	3332
q9	8440	8409	8452	8409
q10	3843	3646	3685	3646
q11	596	477	472	472
q12	782	595	580	580
q13	16704	2913	2937	2913
q14	302	260	274	260
q15	512	482	465	465
q16	465	413	409	409
q17	1729	1468	1477	1468
q18	7517	7465	7536	7465
q19	1628	1542	1555	1542
q20	1968	1760	1763	1760
q21	4975	4795	4831	4795
q22	563	515	497	497
Total cold run time: 70297 ms
Total hot run time: 53876 ms

doris-robot avatar May 06 '24 03:05 doris-robot

TPC-DS: Total hot run time: 184561 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 265f3d98c13b8b50a73b70d176bcefbf36a03f4b, data reload: false

query1	916	354	342	342
query2	6458	2410	2275	2275
query3	6656	200	202	200
query4	22817	21274	21093	21093
query5	4120	419	422	419
query6	267	206	181	181
query7	4588	295	277	277
query8	242	183	183	183
query9	8760	2356	2345	2345
query10	438	243	253	243
query11	14867	14111	14109	14109
query12	139	96	89	89
query13	1640	378	370	370
query14	9577	8281	7360	7360
query15	254	166	171	166
query16	8236	254	248	248
query17	1932	550	535	535
query18	2113	282	263	263
query19	343	146	146	146
query20	92	88	84	84
query21	198	124	127	124
query22	5182	4910	4888	4888
query23	33720	33341	33122	33122
query24	12202	2902	2800	2800
query25	625	359	359	359
query26	1743	148	147	147
query27	2918	305	322	305
query28	7404	2049	2025	2025
query29	1039	608	590	590
query30	299	152	151	151
query31	940	772	728	728
query32	91	52	54	52
query33	741	254	240	240
query34	1008	467	462	462
query35	810	694	661	661
query36	1083	911	924	911
query37	284	69	67	67
query38	2872	2768	2723	2723
query39	1590	1528	1543	1528
query40	273	125	121	121
query41	42	39	40	39
query42	108	96	97	96
query43	569	523	547	523
query44	1220	717	730	717
query45	264	253	255	253
query46	1076	714	688	688
query47	1951	1890	1844	1844
query48	370	287	286	286
query49	1143	383	393	383
query50	783	385	371	371
query51	6739	6744	6600	6600
query52	102	87	93	87
query53	345	275	275	275
query54	310	232	237	232
query55	84	72	71	71
query56	237	227	215	215
query57	1220	1118	1141	1118
query58	221	198	194	194
query59	3437	3162	3014	3014
query60	270	251	232	232
query61	93	85	85	85
query62	664	453	475	453
query63	301	278	275	275
query64	9593	7241	7200	7200
query65	3116	3042	3040	3040
query66	1402	347	349	347
query67	15665	15076	14904	14904
query68	5232	524	519	519
query69	497	297	299	297
query70	1179	1111	1119	1111
query71	414	266	264	264
query72	7197	2533	2320	2320
query73	697	317	314	314
query74	6491	6015	6109	6015
query75	3425	2598	2643	2598
query76	3440	1025	957	957
query77	422	263	263	263
query78	10862	10461	10123	10123
query79	6707	512	517	512
query80	1111	436	429	429
query81	523	222	216	216
query82	996	94	98	94
query83	199	168	168	168
query84	273	84	90	84
query85	1460	269	263	263
query86	465	290	322	290
query87	3286	3066	3023	3023
query88	5330	2311	2314	2311
query89	495	382	377	377
query90	2048	191	184	184
query91	125	101	98	98
query92	62	50	49	49
query93	5456	506	499	499
query94	1170	187	179	179
query95	387	305	297	297
query96	603	261	263	261
query97	3186	2911	2900	2900
query98	247	214	216	214
query99	1270	866	858	858
Total cold run time: 296057 ms
Total hot run time: 184561 ms

doris-robot avatar May 06 '24 03:05 doris-robot

run buildall

keanji-x avatar May 06 '24 05:05 keanji-x

TPC-H: Total hot run time: 40349 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 810cfd26e8051e15e47eea4d677945f52adf7f3f, data reload: false

------ Round 1 ----------------------------------
q1	17843	4458	4279	4279
q2	2024	196	204	196
q3	10616	1246	1225	1225
q4	10294	863	835	835
q5	7539	2738	2711	2711
q6	218	136	133	133
q7	1015	563	543	543
q8	9350	2190	2118	2118
q9	9163	6680	6639	6639
q10	9158	3731	3723	3723
q11	458	245	254	245
q12	453	220	230	220
q13	17772	2997	2956	2956
q14	254	222	224	222
q15	514	468	492	468
q16	514	394	379	379
q17	980	722	677	677
q18	8151	7399	7472	7399
q19	1695	1522	1470	1470
q20	669	321	321	321
q21	5177	3292	4182	3292
q22	365	298	321	298
Total cold run time: 114222 ms
Total hot run time: 40349 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4552	4214	4174	4174
q2	381	276	278	276
q3	3010	2706	2747	2706
q4	1867	1599	1602	1599
q5	5281	5283	5298	5283
q6	213	124	125	124
q7	1790	1507	1439	1439
q8	3234	3398	3381	3381
q9	8444	8464	8487	8464
q10	3867	3642	3707	3642
q11	584	503	491	491
q12	726	593	587	587
q13	13012	2983	2988	2983
q14	296	284	254	254
q15	522	476	487	476
q16	481	409	425	409
q17	1783	1481	1476	1476
q18	7663	7518	7327	7327
q19	3797	1603	1512	1512
q20	1937	1730	1791	1730
q21	5076	4792	4847	4792
q22	590	506	492	492
Total cold run time: 69106 ms
Total hot run time: 53617 ms

doris-robot avatar May 06 '24 06:05 doris-robot

TPC-DS: Total hot run time: 184933 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 810cfd26e8051e15e47eea4d677945f52adf7f3f, data reload: false

query1	903	360	352	352
query2	6472	2401	2324	2324
query3	6652	206	213	206
query4	23090	21450	21147	21147
query5	4127	418	421	418
query6	285	171	167	167
query7	4598	287	279	279
query8	245	205	182	182
query9	8695	2393	2374	2374
query10	448	249	254	249
query11	14716	14119	14126	14119
query12	138	92	91	91
query13	1643	375	378	375
query14	8679	8577	6723	6723
query15	258	169	177	169
query16	8248	268	266	266
query17	1908	574	555	555
query18	2105	280	278	278
query19	363	150	152	150
query20	100	92	86	86
query21	199	133	127	127
query22	5032	4842	4828	4828
query23	33773	33145	33132	33132
query24	10712	2910	2967	2910
query25	616	364	358	358
query26	1343	157	146	146
query27	2998	332	312	312
query28	7802	2059	2066	2059
query29	869	608	587	587
query30	298	149	149	149
query31	984	739	729	729
query32	91	53	53	53
query33	745	246	242	242
query34	1046	480	469	469
query35	805	676	678	676
query36	1118	885	906	885
query37	141	68	65	65
query38	2885	2764	2697	2697
query39	1600	1527	1512	1512
query40	196	122	124	122
query41	41	38	39	38
query42	102	98	100	98
query43	584	548	547	547
query44	1252	744	783	744
query45	255	249	244	244
query46	1085	741	711	711
query47	1953	1851	1831	1831
query48	391	298	291	291
query49	1034	398	402	398
query50	774	403	385	385
query51	6762	6549	6551	6549
query52	102	90	92	90
query53	352	282	288	282
query54	295	236	248	236
query55	80	72	74	72
query56	238	219	226	219
query57	1195	1136	1148	1136
query58	219	202	194	194
query59	3526	3292	3157	3157
query60	285	228	234	228
query61	91	89	93	89
query62	654	462	464	462
query63	307	292	282	282
query64	8702	7211	7216	7211
query65	3127	3044	3039	3039
query66	942	341	335	335
query67	15450	15215	14899	14899
query68	5277	549	541	541
query69	483	309	312	309
query70	1125	1100	1171	1100
query71	402	268	272	268
query72	7981	2577	2386	2386
query73	704	320	320	320
query74	6530	6162	6119	6119
query75	3483	2603	2670	2603
query76	3345	1069	1020	1020
query77	439	267	272	267
query78	11035	10257	10171	10171
query79	3831	517	534	517
query80	1947	433	431	431
query81	538	220	222	220
query82	899	94	89	89
query83	274	192	175	175
query84	264	89	92	89
query85	2135	303	271	271
query86	484	283	299	283
query87	3258	3085	3074	3074
query88	4850	2350	2356	2350
query89	521	383	392	383
query90	2060	186	187	186
query91	127	100	100	100
query92	65	50	48	48
query93	5057	526	510	510
query94	1245	187	186	186
query95	397	311	313	311
query96	597	267	265	265
query97	3155	2961	2928	2928
query98	235	225	220	220
query99	1241	876	858	858
Total cold run time: 290708 ms
Total hot run time: 184933 ms

doris-robot avatar May 06 '24 06:05 doris-robot

run buildall

keanji-x avatar May 06 '24 10:05 keanji-x

run buildall

keanji-x avatar May 06 '24 11:05 keanji-x

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 06 '24 11:05 github-actions[bot]

TPC-H: Total hot run time: 41067 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 23f7a0d3060e14dbea19054a4646737d7449831d, data reload: false

------ Round 1 ----------------------------------
q1	17831	4545	4395	4395
q2	2427	194	203	194
q3	10971	1294	1245	1245
q4	10480	818	789	789
q5	7488	2760	2694	2694
q6	219	138	137	137
q7	1064	628	594	594
q8	9411	2146	2098	2098
q9	9307	6650	6558	6558
q10	8961	3739	3756	3739
q11	471	238	236	236
q12	470	218	226	218
q13	17785	2972	2943	2943
q14	267	225	225	225
q15	511	481	466	466
q16	528	397	387	387
q17	985	662	771	662
q18	7961	7430	7539	7430
q19	4173	1539	1648	1539
q20	649	305	301	301
q21	5063	3946	3993	3946
q22	349	271	285	271
Total cold run time: 117371 ms
Total hot run time: 41067 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4353	4230	4243	4230
q2	386	277	270	270
q3	2977	2814	2739	2739
q4	1867	1570	1623	1570
q5	5275	5315	5330	5315
q6	213	127	127	127
q7	2269	1926	1881	1881
q8	3207	3383	3379	3379
q9	8520	8524	8516	8516
q10	3924	3694	3713	3694
q11	596	485	488	485
q12	760	600	603	600
q13	17589	2934	2957	2934
q14	308	259	256	256
q15	520	482	485	482
q16	467	413	422	413
q17	1796	1491	1455	1455
q18	7557	7571	7482	7482
q19	1679	1531	1575	1531
q20	1978	1785	1780	1780
q21	8060	4859	4977	4859
q22	560	495	520	495
Total cold run time: 74861 ms
Total hot run time: 54493 ms

doris-robot avatar May 06 '24 12:05 doris-robot

TPC-DS: Total hot run time: 186615 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 23f7a0d3060e14dbea19054a4646737d7449831d, data reload: false

query1	922	363	347	347
query2	6460	2487	2349	2349
query3	6642	208	210	208
query4	22936	21559	21411	21411
query5	4181	410	425	410
query6	281	185	181	181
query7	4592	289	296	289
query8	248	199	198	198
query9	8562	2330	2339	2330
query10	439	241	249	241
query11	14857	14117	14184	14117
query12	134	90	90	90
query13	1654	379	364	364
query14	8616	7793	8337	7793
query15	262	161	179	161
query16	8178	273	264	264
query17	1844	554	544	544
query18	2110	292	273	273
query19	292	151	148	148
query20	93	87	83	83
query21	196	125	124	124
query22	4982	4875	4792	4792
query23	33740	33169	33078	33078
query24	10780	2896	2808	2808
query25	626	361	358	358
query26	1517	153	146	146
query27	2946	314	317	314
query28	7476	2036	2026	2026
query29	917	607	597	597
query30	271	149	158	149
query31	941	737	707	707
query32	95	53	55	53
query33	752	251	238	238
query34	1074	484	483	483
query35	824	680	652	652
query36	1089	902	897	897
query37	142	67	69	67
query38	2884	2717	2750	2717
query39	1583	1509	1527	1509
query40	259	126	124	124
query41	42	42	37	37
query42	105	97	98	97
query43	577	537	536	536
query44	1283	722	729	722
query45	269	247	253	247
query46	1096	715	706	706
query47	1947	1848	1867	1848
query48	361	304	294	294
query49	1127	398	411	398
query50	778	394	376	376
query51	6749	6641	6529	6529
query52	99	93	90	90
query53	355	282	295	282
query54	297	235	236	235
query55	80	73	74	73
query56	243	227	222	222
query57	1225	1152	1155	1152
query58	223	200	202	200
query59	3592	3355	3454	3355
query60	248	231	233	231
query61	90	90	90	90
query62	662	434	451	434
query63	308	283	280	280
query64	9258	7193	7200	7193
query65	3104	3023	3068	3023
query66	1399	346	347	346
query67	15522	15068	14806	14806
query68	5161	525	527	525
query69	483	299	318	299
query70	1200	1110	1157	1110
query71	395	268	270	268
query72	7949	2554	2343	2343
query73	705	318	321	318
query74	6397	6134	6186	6134
query75	3496	2577	2642	2577
query76	3418	943	966	943
query77	392	267	265	265
query78	10948	10208	10293	10208
query79	3966	524	517	517
query80	1154	435	419	419
query81	503	222	222	222
query82	815	93	94	93
query83	214	182	179	179
query84	271	89	85	85
query85	1413	296	260	260
query86	469	295	304	295
query87	3248	3072	3067	3067
query88	4765	2311	2295	2295
query89	484	373	383	373
query90	2029	184	182	182
query91	156	102	96	96
query92	55	47	48	47
query93	4836	518	492	492
query94	1193	174	180	174
query95	1099	1094	1095	1094
query96	603	268	262	262
query97	3147	2951	2949	2949
query98	249	219	222	219
query99	1268	863	876	863
Total cold run time: 289917 ms
Total hot run time: 186615 ms

doris-robot avatar May 06 '24 12:05 doris-robot

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar May 07 '24 02:05 github-actions[bot]