doris icon indicating copy to clipboard operation
doris copied to clipboard

[conf](pipeline) Disable non-pipeline engine

Open Gabriel39 opened this issue 9 months ago • 75 comments

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

Gabriel39 avatar May 14 '24 04:05 Gabriel39

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar May 14 '24 04:05 doris-robot

run buildall

Gabriel39 avatar May 14 '24 04:05 Gabriel39

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 14 '24 04:05 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 14 '24 04:05 github-actions[bot]

TPC-H: Total hot run time: 40164 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a7a8710880b9e7266c673cea6b25be762ea2d12e, data reload: false

------ Round 1 ----------------------------------
q1	17598	4352	4264	4264
q2	2027	197	189	189
q3	10559	1199	1226	1199
q4	10283	769	753	753
q5	7507	2722	2654	2654
q6	215	133	143	133
q7	1042	595	582	582
q8	9382	2172	2135	2135
q9	9271	6716	6636	6636
q10	9888	3751	3746	3746
q11	460	241	230	230
q12	482	220	218	218
q13	18839	2972	2987	2972
q14	268	207	225	207
q15	525	473	477	473
q16	495	393	373	373
q17	979	705	676	676
q18	8065	7447	7458	7447
q19	4250	1558	1526	1526
q20	651	309	304	304
q21	5226	3241	3176	3176
q22	337	271	281	271
Total cold run time: 118349 ms
Total hot run time: 40164 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4351	4304	4220	4220
q2	356	260	261	260
q3	3044	2741	2784	2741
q4	1850	1584	1627	1584
q5	5299	5242	5314	5242
q6	207	124	124	124
q7	2230	1876	1894	1876
q8	3211	3345	3336	3336
q9	8378	8325	8382	8325
q10	3855	3759	3714	3714
q11	591	510	479	479
q12	769	596	592	592
q13	16382	2963	2964	2963
q14	287	270	261	261
q15	517	462	475	462
q16	454	407	414	407
q17	1765	1506	1476	1476
q18	7711	7457	7444	7444
q19	1646	1558	1575	1558
q20	1979	1752	1797	1752
q21	5077	4775	4882	4775
q22	593	517	507	507
Total cold run time: 70552 ms
Total hot run time: 54098 ms

doris-robot avatar May 14 '24 05:05 doris-robot

TPC-DS: Total hot run time: 187183 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a7a8710880b9e7266c673cea6b25be762ea2d12e, data reload: false

query1	909	389	349	349
query2	7820	2254	2330	2254
query3	6664	206	217	206
query4	23180	21128	21263	21128
query5	4139	443	407	407
query6	273	170	187	170
query7	4581	297	294	294
query8	238	190	190	190
query9	8831	2418	2387	2387
query10	442	247	268	247
query11	14838	14131	14122	14122
query12	138	93	107	93
query13	1648	364	369	364
query14	9589	8518	7835	7835
query15	271	165	168	165
query16	8178	259	272	259
query17	1857	564	539	539
query18	2092	272	271	271
query19	242	143	149	143
query20	91	86	84	84
query21	211	136	125	125
query22	5058	4861	4861	4861
query23	34296	33486	33550	33486
query24	11144	2847	2987	2847
query25	607	376	361	361
query26	1592	153	148	148
query27	2942	321	337	321
query28	7412	2064	2051	2051
query29	946	610	596	596
query30	284	152	150	150
query31	977	774	745	745
query32	97	52	53	52
query33	758	252	249	249
query34	1064	478	479	478
query35	806	691	669	669
query36	1098	926	933	926
query37	133	68	65	65
query38	2885	2772	2759	2759
query39	1618	1570	1560	1560
query40	270	127	121	121
query41	40	38	38	38
query42	105	94	97	94
query43	560	548	550	548
query44	1218	715	723	715
query45	274	255	227	227
query46	1080	733	722	722
query47	1937	1865	1911	1865
query48	367	296	289	289
query49	1163	413	392	392
query50	780	380	384	380
query51	6822	6838	6827	6827
query52	102	86	90	86
query53	348	282	291	282
query54	1023	441	431	431
query55	73	74	72	72
query56	247	216	224	216
query57	1236	1144	1165	1144
query58	219	203	205	203
query59	3555	3308	3124	3124
query60	250	224	237	224
query61	90	87	86	86
query62	669	492	459	459
query63	314	280	283	280
query64	9775	7537	7488	7488
query65	3157	3142	3074	3074
query66	1399	353	346	346
query67	15215	15134	14955	14955
query68	6085	541	530	530
query69	546	298	302	298
query70	1124	1093	1068	1068
query71	471	270	268	268
query72	8172	2677	2545	2545
query73	723	318	319	318
query74	6592	6119	6127	6119
query75	4048	2669	2618	2618
query76	4141	998	1038	998
query77	641	261	257	257
query78	10805	10186	10050	10050
query79	3660	501	512	501
query80	1112	451	435	435
query81	508	222	218	218
query82	826	95	92	92
query83	194	167	162	162
query84	267	86	82	82
query85	1407	267	258	258
query86	483	308	307	307
query87	3262	3088	3051	3051
query88	4727	2365	2347	2347
query89	473	373	371	371
query90	1974	181	184	181
query91	131	96	98	96
query92	54	51	52	51
query93	4760	527	499	499
query94	1145	182	176	176
query95	393	289	297	289
query96	593	264	267	264
query97	3182	2967	2999	2967
query98	240	224	214	214
query99	1265	913	909	909
Total cold run time: 296241 ms
Total hot run time: 187183 ms

doris-robot avatar May 14 '24 05:05 doris-robot

TeamCity be ut coverage result: Function Coverage: 35.66% (8980/25180) Line Coverage: 27.32% (74237/271751) Region Coverage: 26.55% (38348/144451) Branch Coverage: 23.37% (19564/83702) Coverage Report: http://coverage.selectdb-in.cc/coverage/a7a8710880b9e7266c673cea6b25be762ea2d12e_a7a8710880b9e7266c673cea6b25be762ea2d12e/report/index.html

doris-robot avatar May 14 '24 05:05 doris-robot

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 14 '24 07:05 github-actions[bot]

run buildall

Gabriel39 avatar May 14 '24 08:05 Gabriel39

TeamCity be ut coverage result: Function Coverage: 35.67% (8982/25180) Line Coverage: 27.33% (74262/271739) Region Coverage: 26.57% (38374/144448) Branch Coverage: 23.38% (19569/83696) Coverage Report: http://coverage.selectdb-in.cc/coverage/90e500c28e20e05d415661feb76a3abaabc2e651_90e500c28e20e05d415661feb76a3abaabc2e651/report/index.html

doris-robot avatar May 14 '24 09:05 doris-robot

run buildall

Gabriel39 avatar May 15 '24 02:05 Gabriel39

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 15 '24 02:05 github-actions[bot]

TPC-H: Total hot run time: 40805 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8572e738bdb9572fdd126d30c1484705853b364d, data reload: false

------ Round 1 ----------------------------------
q1	18023	4537	4392	4392
q2	2631	200	187	187
q3	11212	1181	1216	1181
q4	10637	794	765	765
q5	7688	2730	2700	2700
q6	217	133	134	133
q7	998	585	556	556
q8	9242	2111	2071	2071
q9	9030	6528	6534	6528
q10	8904	3692	3723	3692
q11	442	244	233	233
q12	395	222	220	220
q13	18602	2988	2986	2986
q14	261	211	213	211
q15	514	476	457	457
q16	496	381	381	381
q17	984	640	764	640
q18	8138	7546	7434	7434
q19	5197	1530	1476	1476
q20	653	301	303	301
q21	5042	3976	3998	3976
q22	326	285	287	285
Total cold run time: 119632 ms
Total hot run time: 40805 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4372	4250	4198	4198
q2	368	270	257	257
q3	2977	2750	2756	2750
q4	1842	1647	1615	1615
q5	5315	5287	5281	5281
q6	212	125	123	123
q7	2235	1864	1885	1864
q8	3213	3333	3338	3333
q9	8360	8438	8329	8329
q10	3863	3653	3653	3653
q11	580	478	484	478
q12	784	583	565	565
q13	16604	2926	2957	2926
q14	284	266	266	266
q15	516	480	473	473
q16	482	403	426	403
q17	1780	1467	1464	1464
q18	7668	7472	7451	7451
q19	1709	1577	1544	1544
q20	1977	1746	1764	1746
q21	4929	4779	4972	4779
q22	601	485	503	485
Total cold run time: 70671 ms
Total hot run time: 53983 ms

doris-robot avatar May 15 '24 04:05 doris-robot

TPC-DS: Total hot run time: 187878 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8572e738bdb9572fdd126d30c1484705853b364d, data reload: false

query1	927	392	370	370
query2	6447	2335	2304	2304
query3	6653	213	221	213
query4	23018	21391	21258	21258
query5	4203	424	430	424
query6	272	176	193	176
query7	4586	294	286	286
query8	247	202	198	198
query9	8539	2401	2399	2399
query10	435	270	255	255
query11	14805	14161	14135	14135
query12	143	92	89	89
query13	1652	372	374	372
query14	8885	8395	8743	8395
query15	258	168	175	168
query16	8192	261	258	258
query17	1862	592	537	537
query18	2108	277	262	262
query19	241	148	150	148
query20	92	84	83	83
query21	194	131	138	131
query22	5056	4924	4891	4891
query23	34397	33518	33446	33446
query24	11456	3018	2931	2931
query25	640	370	372	370
query26	1757	156	149	149
query27	2927	318	324	318
query28	7520	2052	2046	2046
query29	992	629	617	617
query30	311	181	177	177
query31	970	763	731	731
query32	94	51	53	51
query33	755	249	243	243
query34	1056	503	493	493
query35	819	697	679	679
query36	1090	903	932	903
query37	141	76	71	71
query38	2933	2791	2754	2754
query39	1615	1543	1566	1543
query40	281	129	127	127
query41	48	43	43	43
query42	103	96	96	96
query43	575	574	569	569
query44	1262	740	751	740
query45	270	256	259	256
query46	1069	730	710	710
query47	1938	1873	1893	1873
query48	368	296	311	296
query49	1173	402	403	402
query50	772	389	394	389
query51	6844	6840	6779	6779
query52	107	93	92	92
query53	365	286	292	286
query54	910	428	436	428
query55	73	73	74	73
query56	235	218	221	218
query57	1220	1146	1122	1122
query58	225	201	204	201
query59	3274	3017	3062	3017
query60	259	232	234	232
query61	91	89	88	88
query62	683	459	464	459
query63	329	289	288	288
query64	9775	7380	7415	7380
query65	3132	3123	3105	3105
query66	1379	344	347	344
query67	15403	14849	14911	14849
query68	4701	548	551	548
query69	520	303	310	303
query70	1210	1135	1149	1135
query71	416	265	264	264
query72	7835	2531	2334	2334
query73	711	322	329	322
query74	6591	6181	6116	6116
query75	3698	2609	2615	2609
query76	3427	949	1000	949
query77	650	273	272	272
query78	10577	10064	10139	10064
query79	2250	522	523	522
query80	820	455	450	450
query81	514	251	245	245
query82	785	108	101	101
query83	284	171	172	171
query84	248	92	88	88
query85	1660	264	265	264
query86	501	330	311	311
query87	3291	3080	3116	3080
query88	4160	2343	2347	2343
query89	488	395	407	395
query90	1959	188	189	188
query91	125	100	97	97
query92	58	49	51	49
query93	2096	514	497	497
query94	1198	185	189	185
query95	397	300	309	300
query96	594	285	271	271
query97	3167	2963	3023	2963
query98	232	220	223	220
query99	1128	892	886	886
Total cold run time: 286742 ms
Total hot run time: 187878 ms

doris-robot avatar May 15 '24 04:05 doris-robot

ClickBench: Total hot run time: 30.71 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8572e738bdb9572fdd126d30c1484705853b364d, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.05
query3	0.24	0.06	0.06
query4	1.64	0.08	0.10
query5	0.50	0.49	0.54
query6	1.13	0.71	0.72
query7	0.02	0.01	0.01
query8	0.05	0.03	0.04
query9	0.54	0.48	0.48
query10	0.53	0.53	0.55
query11	0.15	0.12	0.11
query12	0.14	0.12	0.12
query13	0.60	0.60	0.59
query14	0.78	0.79	0.75
query15	0.83	0.81	0.81
query16	0.36	0.37	0.37
query17	1.04	1.03	1.01
query18	0.21	0.22	0.26
query19	1.85	1.73	1.70
query20	0.01	0.02	0.01
query21	15.64	0.67	0.68
query22	4.41	7.09	2.31
query23	18.28	1.31	1.18
query24	1.88	0.25	0.21
query25	0.15	0.09	0.09
query26	0.27	0.17	0.17
query27	0.08	0.08	0.07
query28	13.33	1.01	1.00
query29	12.67	3.31	3.29
query30	0.24	0.06	0.05
query31	2.85	0.40	0.39
query32	3.25	0.46	0.47
query33	2.77	2.83	2.85
query34	17.28	4.41	4.37
query35	4.55	4.46	4.52
query36	0.64	0.45	0.45
query37	0.18	0.15	0.15
query38	0.15	0.14	0.14
query39	0.04	0.03	0.03
query40	0.16	0.13	0.14
query41	0.09	0.05	0.04
query42	0.06	0.04	0.04
query43	0.04	0.04	0.03
Total cold run time: 109.75 s
Total hot run time: 30.71 s

doris-robot avatar May 15 '24 04:05 doris-robot

TeamCity be ut coverage result: Function Coverage: 35.66% (8984/25192) Line Coverage: 27.33% (74279/271801) Region Coverage: 26.56% (38389/144518) Branch Coverage: 23.38% (19579/83738) Coverage Report: http://coverage.selectdb-in.cc/coverage/8572e738bdb9572fdd126d30c1484705853b364d_8572e738bdb9572fdd126d30c1484705853b364d/report/index.html

doris-robot avatar May 15 '24 04:05 doris-robot

run buildall

Gabriel39 avatar May 15 '24 15:05 Gabriel39

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 15 '24 15:05 github-actions[bot]

TeamCity be ut coverage result: Function Coverage: 35.71% (8998/25199) Line Coverage: 27.38% (74451/271951) Region Coverage: 26.61% (38487/144614) Branch Coverage: 23.43% (19632/83804) Coverage Report: http://coverage.selectdb-in.cc/coverage/6476cfe178cfe49986285942d0a8dbef2b8ab5e8_6476cfe178cfe49986285942d0a8dbef2b8ab5e8/report/index.html

doris-robot avatar May 15 '24 16:05 doris-robot

run buildall

Gabriel39 avatar May 16 '24 00:05 Gabriel39

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 16 '24 00:05 github-actions[bot]

TeamCity be ut coverage result: Function Coverage: 35.71% (8998/25199) Line Coverage: 27.37% (74422/271951) Region Coverage: 26.61% (38482/144614) Branch Coverage: 23.43% (19634/83804) Coverage Report: http://coverage.selectdb-in.cc/coverage/cc516decc5bcf73e9e59b3482ae8f3adeadc1a60_cc516decc5bcf73e9e59b3482ae8f3adeadc1a60/report/index.html

doris-robot avatar May 16 '24 00:05 doris-robot

run buildall

Gabriel39 avatar May 16 '24 04:05 Gabriel39

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 16 '24 04:05 github-actions[bot]

TeamCity be ut coverage result: Function Coverage: 35.69% (8996/25207) Line Coverage: 27.36% (74430/272047) Region Coverage: 26.60% (38469/144645) Branch Coverage: 23.42% (19625/83802) Coverage Report: http://coverage.selectdb-in.cc/coverage/43673b89a5c4fafb0d9752517650db6cb1c7c154_43673b89a5c4fafb0d9752517650db6cb1c7c154/report/index.html

doris-robot avatar May 16 '24 06:05 doris-robot

run buildall

Gabriel39 avatar May 16 '24 11:05 Gabriel39

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 16 '24 11:05 github-actions[bot]

TeamCity be ut coverage result: Function Coverage: 35.70% (9004/25219) Line Coverage: 27.37% (74491/272148) Region Coverage: 26.61% (38511/144709) Branch Coverage: 23.43% (19646/83838) Coverage Report: http://coverage.selectdb-in.cc/coverage/d27f6722538a07617a7739b9760f2e6392d17d10_d27f6722538a07617a7739b9760f2e6392d17d10/report/index.html

doris-robot avatar May 16 '24 12:05 doris-robot

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 16 '24 14:05 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 16 '24 14:05 github-actions[bot]