doris icon indicating copy to clipboard operation
doris copied to clipboard

[opt][fe/be.conf]optimise system environment replacing rule in conf file

Open zhaorongsheng opened this issue 7 months ago • 58 comments

What problem does this PR solve?

Issue Number: close #51200

Related PR: #xxx

Problem Summary:

It does not support $xx format in conf file. If we set ssl_certificate_path=$DORIS_HOME/conf/cert.pem the value of the key ssl_certificate_path is $DORIS_HOME/conf/cert.pem. But in fact the value of $DORIS_HOME must be replaced by the system environment.

Release note

None

Check List (For Author)

  • Test

    • [ ] Regression test
    • [x] Unit Test
    • [ ] Manual test (add detailed scripts or steps below)
    • [ ] No need to test or manual test. Explain why:
      • [ ] This is a refactor/code format and no logic has been changed.
      • [ ] Previous test can cover this change.
      • [ ] No code files have been changed.
      • [ ] Other reason
  • Behavior changed:

    • [x] No.
    • [ ] Yes.
  • Does this need documentation?

    • [x] No.
    • [ ] Yes.

Check List (For Reviewer who merge this PR)

  • [ ] Confirm the release note
  • [ ] Confirm test cases
  • [ ] Confirm document
  • [ ] Add branch pick label

zhaorongsheng avatar May 23 '25 10:05 zhaorongsheng

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

Thearas avatar May 23 '25 10:05 Thearas

run buildall

zhaorongsheng avatar May 24 '25 01:05 zhaorongsheng

Cloud UT Coverage Report

Increment line coverage 22.45% (11/49) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 83.25% (1113/1337)
Line Coverage 66.06% (18666/28255)
Region Coverage 65.67% (9267/14111)
Branch Coverage 55.42% (4983/8992)

doris-robot avatar May 24 '25 01:05 doris-robot

TPC-H: Total hot run time: 33837 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 986128a9e5d7cef633d4749da1f94ec4abfbab36, data reload: false

------ Round 1 ----------------------------------
q1	26529	5103	5006	5006
q2	2078	279	182	182
q3	10404	1230	694	694
q4	10225	981	542	542
q5	7515	2318	2288	2288
q6	183	168	130	130
q7	867	732	611	611
q8	9337	1249	1008	1008
q9	6838	5049	5128	5049
q10	6833	2322	1903	1903
q11	493	296	281	281
q12	340	358	222	222
q13	18269	3689	3125	3125
q14	241	233	215	215
q15	547	480	493	480
q16	436	438	377	377
q17	622	850	385	385
q18	8295	7312	7111	7111
q19	1234	940	559	559
q20	343	343	239	239
q21	3900	3209	2393	2393
q22	1055	1075	1037	1037
Total cold run time: 116584 ms
Total hot run time: 33837 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5197	5103	5186	5103
q2	259	335	238	238
q3	2266	2768	2547	2547
q4	1525	1939	1504	1504
q5	4586	4592	4554	4554
q6	230	167	129	129
q7	2076	2020	1856	1856
q8	2670	2719	2620	2620
q9	7329	7164	7190	7164
q10	2966	3249	2828	2828
q11	602	519	516	516
q12	685	781	592	592
q13	3525	3909	3292	3292
q14	276	299	285	285
q15	535	474	476	474
q16	461	501	461	461
q17	1153	1577	1381	1381
q18	7888	7678	7413	7413
q19	807	833	991	833
q20	2035	2049	1942	1942
q21	4762	4411	4369	4369
q22	1079	1068	1002	1002
Total cold run time: 52912 ms
Total hot run time: 51103 ms

doris-robot avatar May 24 '25 02:05 doris-robot

TPC-DS: Total hot run time: 192801 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 986128a9e5d7cef633d4749da1f94ec4abfbab36, data reload: false

query1	1432	1095	1081	1081
query2	6516	1834	1826	1826
query3	11030	4412	4439	4412
query4	54727	25054	23412	23412
query5	5027	549	470	470
query6	375	219	211	211
query7	4971	535	294	294
query8	338	263	243	243
query9	5829	2643	2665	2643
query10	445	347	288	288
query11	15138	15000	14847	14847
query12	163	117	114	114
query13	1098	539	425	425
query14	10166	6367	6288	6288
query15	203	212	176	176
query16	7040	676	505	505
query17	1059	736	575	575
query18	1595	403	309	309
query19	196	190	162	162
query20	131	128	128	128
query21	206	126	110	110
query22	4367	4324	4307	4307
query23	34293	33400	33622	33400
query24	7148	2417	2429	2417
query25	496	515	418	418
query26	673	300	155	155
query27	2205	533	346	346
query28	3238	2158	2156	2156
query29	617	601	463	463
query30	281	221	198	198
query31	900	882	838	838
query32	79	69	73	69
query33	470	381	321	321
query34	782	890	571	571
query35	788	854	770	770
query36	943	1003	906	906
query37	147	108	78	78
query38	4305	4372	4245	4245
query39	1606	1456	1453	1453
query40	212	121	110	110
query41	81	55	52	52
query42	127	115	109	109
query43	535	523	481	481
query44	1363	852	860	852
query45	178	177	174	174
query46	875	1038	661	661
query47	1868	1882	1792	1792
query48	398	443	341	341
query49	722	521	453	453
query50	699	724	407	407
query51	4271	4437	4152	4152
query52	106	113	101	101
query53	226	266	202	202
query54	594	585	524	524
query55	92	88	89	88
query56	319	314	293	293
query57	1184	1202	1135	1135
query58	267	263	269	263
query59	2744	2846	2745	2745
query60	340	344	322	322
query61	146	130	132	130
query62	714	706	643	643
query63	224	182	190	182
query64	1789	1091	695	695
query65	4263	4205	4204	4204
query66	728	411	306	306
query67	16302	15859	15456	15456
query68	7767	898	531	531
query69	543	318	276	276
query70	1232	1133	1069	1069
query71	515	321	309	309
query72	5963	4756	4942	4756
query73	1373	640	355	355
query74	8936	8891	8662	8662
query75	3821	3208	2731	2731
query76	4276	1201	760	760
query77	609	358	341	341
query78	10046	10319	9322	9322
query79	2397	801	590	590
query80	643	526	465	465
query81	474	254	220	220
query82	293	131	97	97
query83	256	255	240	240
query84	301	114	85	85
query85	811	361	320	320
query86	397	299	290	290
query87	4397	4477	4321	4321
query88	3780	2321	2315	2315
query89	420	318	298	298
query90	1794	208	209	208
query91	143	147	117	117
query92	76	67	55	55
query93	2034	935	582	582
query94	633	436	297	297
query95	381	291	294	291
query96	502	580	285	285
query97	2803	2787	2636	2636
query98	247	210	207	207
query99	1353	1405	1267	1267
Total cold run time: 301606 ms
Total hot run time: 192801 ms

doris-robot avatar May 24 '25 02:05 doris-robot

ClickBench: Total hot run time: 29.23 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 986128a9e5d7cef633d4749da1f94ec4abfbab36, data reload: false

query1	0.04	0.04	0.03
query2	0.14	0.10	0.12
query3	0.26	0.19	0.20
query4	1.61	0.21	0.19
query5	0.46	0.45	0.43
query6	1.15	0.67	0.65
query7	0.02	0.02	0.01
query8	0.04	0.04	0.04
query9	0.59	0.51	0.54
query10	0.58	0.58	0.58
query11	0.16	0.12	0.11
query12	0.15	0.11	0.12
query13	0.62	0.60	0.60
query14	0.78	0.81	0.81
query15	0.89	0.88	0.87
query16	0.39	0.40	0.38
query17	1.04	1.05	1.07
query18	0.23	0.22	0.21
query19	1.94	1.78	1.82
query20	0.01	0.01	0.02
query21	15.40	0.90	0.54
query22	0.76	1.15	0.73
query23	14.91	1.38	0.65
query24	7.19	0.91	0.65
query25	0.47	0.14	0.13
query26	0.69	0.17	0.15
query27	0.06	0.05	0.05
query28	9.18	0.91	0.44
query29	12.53	4.14	3.41
query30	0.25	0.10	0.06
query31	2.81	0.61	0.39
query32	3.23	0.55	0.48
query33	3.03	3.10	3.05
query34	15.86	5.16	4.49
query35	4.60	4.55	4.53
query36	0.68	0.51	0.49
query37	0.08	0.07	0.07
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.14	0.13
query41	0.08	0.02	0.02
query42	0.04	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 103.24 s
Total hot run time: 29.23 s

doris-robot avatar May 24 '25 02:05 doris-robot

run buildall

zhaorongsheng avatar May 26 '25 02:05 zhaorongsheng

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar May 26 '25 03:05 github-actions[bot]

PR approved by anyone and no changes requested.

github-actions[bot] avatar May 26 '25 03:05 github-actions[bot]

Cloud UT Coverage Report

Increment line coverage 22.45% (11/49) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 83.25% (1113/1337)
Line Coverage 66.11% (18679/28255)
Region Coverage 65.67% (9266/14111)
Branch Coverage 55.46% (4987/8992)

doris-robot avatar May 26 '25 03:05 doris-robot

run buildall

zhaorongsheng avatar May 27 '25 03:05 zhaorongsheng

Cloud UT Coverage Report

Increment line coverage 22.45% (11/49) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 83.25% (1113/1337)
Line Coverage 66.07% (18669/28255)
Region Coverage 65.69% (9270/14111)
Branch Coverage 55.46% (4987/8992)

hello-stephen avatar May 27 '25 03:05 hello-stephen

TPC-H: Total hot run time: 33757 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1a29fe09410e6e0f37721defb55847d1ee66634a, data reload: false

------ Round 1 ----------------------------------
q1	26002	5621	5046	5046
q2	2092	291	203	203
q3	10470	1233	690	690
q4	10224	995	519	519
q5	7596	2310	2340	2310
q6	179	161	134	134
q7	904	715	611	611
q8	9296	1192	1050	1050
q9	6788	5118	5142	5118
q10	6884	2327	1906	1906
q11	483	284	267	267
q12	340	351	212	212
q13	17767	3690	3095	3095
q14	244	233	213	213
q15	537	482	490	482
q16	430	437	377	377
q17	613	849	361	361
q18	7514	7159	7127	7127
q19	1808	947	545	545
q20	329	324	217	217
q21	3799	3178	2305	2305
q22	1055	975	969	969
Total cold run time: 115354 ms
Total hot run time: 33757 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5226	5063	5116	5063
q2	245	327	232	232
q3	2182	2644	2315	2315
q4	1337	1819	1360	1360
q5	4452	4392	4404	4392
q6	220	169	128	128
q7	1981	1952	1754	1754
q8	2554	2618	2525	2525
q9	7289	7213	6926	6926
q10	3018	3189	2771	2771
q11	569	504	499	499
q12	662	737	641	641
q13	3502	3930	3343	3343
q14	308	326	263	263
q15	525	489	491	489
q16	446	519	432	432
q17	1147	1527	1402	1402
q18	7774	7619	7340	7340
q19	785	811	855	811
q20	1994	2062	1970	1970
q21	4913	4468	4512	4468
q22	1126	1037	1020	1020
Total cold run time: 52255 ms
Total hot run time: 50144 ms

doris-robot avatar May 27 '25 05:05 doris-robot

TPC-DS: Total hot run time: 193465 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1a29fe09410e6e0f37721defb55847d1ee66634a, data reload: false

query1	1416	1070	1060	1060
query2	6348	1840	1832	1832
query3	11145	4658	4489	4489
query4	51788	25797	23544	23544
query5	5328	564	459	459
query6	333	217	214	214
query7	4903	508	302	302
query8	314	238	228	228
query9	5585	2626	2619	2619
query10	454	325	277	277
query11	15132	14987	15140	14987
query12	163	109	108	108
query13	1071	531	422	422
query14	10101	6263	6573	6263
query15	200	198	184	184
query16	7141	671	513	513
query17	1107	768	605	605
query18	1556	417	316	316
query19	211	207	176	176
query20	147	128	126	126
query21	208	129	111	111
query22	4419	4381	4356	4356
query23	34279	33552	33681	33552
query24	6536	2418	2443	2418
query25	473	497	410	410
query26	725	293	158	158
query27	2254	512	349	349
query28	3183	2165	2154	2154
query29	596	557	441	441
query30	268	218	188	188
query31	865	852	765	765
query32	73	64	63	63
query33	476	368	316	316
query34	788	855	551	551
query35	789	897	780	780
query36	969	978	893	893
query37	111	102	77	77
query38	4198	4250	4145	4145
query39	1525	1462	1465	1462
query40	215	124	116	116
query41	56	51	51	51
query42	131	110	113	110
query43	545	517	503	503
query44	1329	855	870	855
query45	183	175	173	173
query46	854	1043	665	665
query47	1855	1868	1790	1790
query48	414	453	335	335
query49	687	500	434	434
query50	701	691	416	416
query51	4157	4198	4210	4198
query52	109	114	102	102
query53	221	257	190	190
query54	584	580	514	514
query55	92	89	85	85
query56	328	343	297	297
query57	1182	1212	1148	1148
query58	288	264	269	264
query59	2778	2908	2716	2716
query60	341	343	332	332
query61	130	126	133	126
query62	726	750	693	693
query63	230	192	186	186
query64	1709	1037	739	739
query65	4319	4236	4200	4200
query66	729	401	309	309
query67	15823	15508	15414	15414
query68	6937	894	536	536
query69	539	323	276	276
query70	1200	1105	1089	1089
query71	506	321	311	311
query72	5829	4769	4781	4769
query73	1473	613	355	355
query74	8998	9231	8895	8895
query75	3935	3199	2706	2706
query76	4159	1180	751	751
query77	722	374	295	295
query78	10153	10029	9318	9318
query79	2792	820	587	587
query80	797	510	453	453
query81	485	253	221	221
query82	445	129	92	92
query83	311	251	231	231
query84	294	107	85	85
query85	773	355	386	355
query86	367	313	294	294
query87	4288	4396	4332	4332
query88	3492	2268	2282	2268
query89	404	326	285	285
query90	1786	202	204	202
query91	138	141	109	109
query92	69	56	57	56
query93	2176	942	577	577
query94	671	408	382	382
query95	371	301	278	278
query96	500	570	282	282
query97	2728	2738	2703	2703
query98	239	220	213	213
query99	1421	1397	1285	1285
Total cold run time: 296892 ms
Total hot run time: 193465 ms

doris-robot avatar May 27 '25 05:05 doris-robot

ClickBench: Total hot run time: 28.95 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1a29fe09410e6e0f37721defb55847d1ee66634a, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.10	0.11
query3	0.25	0.20	0.19
query4	1.59	0.19	0.11
query5	0.41	0.41	0.44
query6	1.16	0.65	0.67
query7	0.02	0.01	0.01
query8	0.04	0.04	0.04
query9	0.59	0.51	0.52
query10	0.58	0.58	0.56
query11	0.15	0.11	0.11
query12	0.14	0.12	0.11
query13	0.62	0.61	0.59
query14	0.78	0.81	0.81
query15	0.89	0.87	0.87
query16	0.39	0.38	0.39
query17	1.03	1.04	1.02
query18	0.22	0.21	0.21
query19	1.94	1.83	1.83
query20	0.01	0.01	0.02
query21	15.38	0.94	0.56
query22	0.73	1.04	0.74
query23	14.97	1.39	0.67
query24	6.86	1.54	0.47
query25	0.50	0.16	0.08
query26	0.63	0.17	0.15
query27	0.05	0.05	0.05
query28	9.25	0.96	0.46
query29	12.65	4.08	3.41
query30	0.25	0.09	0.07
query31	2.82	0.61	0.39
query32	3.23	0.54	0.46
query33	3.06	3.01	3.07
query34	15.83	5.12	4.52
query35	4.48	4.56	4.54
query36	0.65	0.50	0.49
query37	0.09	0.07	0.06
query38	0.05	0.04	0.03
query39	0.04	0.03	0.03
query40	0.16	0.14	0.14
query41	0.08	0.03	0.03
query42	0.04	0.03	0.02
query43	0.04	0.02	0.03
Total cold run time: 102.81 s
Total hot run time: 28.95 s

doris-robot avatar May 27 '25 05:05 doris-robot

run buildall

zhaorongsheng avatar May 27 '25 07:05 zhaorongsheng

Cloud UT Coverage Report

Increment line coverage 22.45% (11/49) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 83.25% (1113/1337)
Line Coverage 66.07% (18669/28255)
Region Coverage 65.63% (9261/14111)
Branch Coverage 55.44% (4985/8992)

doris-robot avatar May 27 '25 07:05 doris-robot

TPC-H: Total hot run time: 33542 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 383982ce4ac66b48b4e9d7395bc4c2c4ffa2efab, data reload: false

------ Round 1 ----------------------------------
q1	26287	4988	4949	4949
q2	2078	278	186	186
q3	10882	1233	676	676
q4	10217	1007	540	540
q5	7530	2254	2335	2254
q6	180	164	137	137
q7	906	745	623	623
q8	9330	1291	1067	1067
q9	6809	5125	5105	5105
q10	6862	2293	1893	1893
q11	491	284	271	271
q12	336	346	213	213
q13	17765	3618	3100	3100
q14	219	226	214	214
q15	529	481	484	481
q16	426	424	371	371
q17	566	840	341	341
q18	7593	7173	7069	7069
q19	1288	943	547	547
q20	329	325	210	210
q21	3697	3113	2305	2305
q22	1060	996	990	990
Total cold run time: 115380 ms
Total hot run time: 33542 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5059	5029	5040	5029
q2	242	316	232	232
q3	2174	2645	2228	2228
q4	1335	1772	1358	1358
q5	4418	4353	4383	4353
q6	211	168	132	132
q7	2018	1975	1750	1750
q8	2534	2585	2517	2517
q9	7224	7258	6953	6953
q10	3051	3184	2733	2733
q11	571	506	515	506
q12	664	745	624	624
q13	3488	3863	3236	3236
q14	269	299	263	263
q15	546	493	504	493
q16	448	483	424	424
q17	1133	1520	1395	1395
q18	7656	7662	7495	7495
q19	783	769	929	769
q20	2041	2083	1871	1871
q21	4727	4451	4386	4386
q22	1095	1051	1036	1036
Total cold run time: 51687 ms
Total hot run time: 49783 ms

doris-robot avatar May 27 '25 08:05 doris-robot

TPC-DS: Total hot run time: 193005 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 383982ce4ac66b48b4e9d7395bc4c2c4ffa2efab, data reload: false

query1	1410	1080	1050	1050
query2	6123	1913	1927	1913
query3	11020	4592	4615	4592
query4	53929	24935	22989	22989
query5	5138	512	468	468
query6	341	220	205	205
query7	4867	519	297	297
query8	321	251	236	236
query9	5262	2626	2629	2626
query10	411	336	268	268
query11	14925	15066	14881	14881
query12	171	114	105	105
query13	1032	541	410	410
query14	10103	6479	6329	6329
query15	210	235	180	180
query16	7077	652	452	452
query17	1069	739	569	569
query18	1522	400	302	302
query19	226	189	170	170
query20	130	128	124	124
query21	209	135	110	110
query22	4613	4581	4350	4350
query23	34262	33684	33773	33684
query24	6710	2433	2413	2413
query25	453	466	418	418
query26	733	267	152	152
query27	2429	518	345	345
query28	3029	2165	2139	2139
query29	566	559	437	437
query30	274	220	202	202
query31	890	889	800	800
query32	75	63	62	62
query33	453	371	306	306
query34	781	860	546	546
query35	826	838	782	782
query36	974	1026	910	910
query37	112	101	89	89
query38	4211	4379	4203	4203
query39	1535	1457	1464	1457
query40	211	125	112	112
query41	61	55	52	52
query42	128	111	113	111
query43	516	542	489	489
query44	1323	819	847	819
query45	185	173	173	173
query46	840	1025	654	654
query47	1875	1906	1794	1794
query48	398	452	319	319
query49	704	520	441	441
query50	681	706	413	413
query51	4261	4290	4209	4209
query52	116	120	104	104
query53	228	253	185	185
query54	588	589	529	529
query55	88	85	83	83
query56	322	311	287	287
query57	1194	1209	1114	1114
query58	278	261	272	261
query59	2841	2970	2692	2692
query60	358	338	319	319
query61	129	131	141	131
query62	786	747	679	679
query63	233	197	195	195
query64	1824	1021	778	778
query65	4334	4259	4255	4255
query66	760	397	297	297
query67	15927	15666	15492	15492
query68	9122	822	521	521
query69	533	309	270	270
query70	1176	1065	1102	1065
query71	503	325	306	306
query72	5663	4866	4925	4866
query73	1322	664	356	356
query74	9230	9263	8849	8849
query75	3802	3272	2710	2710
query76	4246	1183	748	748
query77	619	361	293	293
query78	10176	10136	9251	9251
query79	2635	822	591	591
query80	684	506	444	444
query81	503	259	216	216
query82	418	125	95	95
query83	254	254	227	227
query84	298	109	81	81
query85	775	349	320	320
query86	399	297	307	297
query87	4353	4496	4357	4357
query88	3671	2268	2279	2268
query89	432	317	293	293
query90	1840	208	199	199
query91	143	140	112	112
query92	73	58	53	53
query93	2175	940	581	581
query94	676	411	300	300
query95	377	294	287	287
query96	502	571	282	282
query97	2747	2741	2656	2656
query98	243	214	203	203
query99	1461	1421	1350	1350
Total cold run time: 300662 ms
Total hot run time: 193005 ms

doris-robot avatar May 27 '25 08:05 doris-robot

ClickBench: Total hot run time: 29.24 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 383982ce4ac66b48b4e9d7395bc4c2c4ffa2efab, data reload: false

query1	0.04	0.04	0.03
query2	0.13	0.10	0.12
query3	0.25	0.19	0.19
query4	1.60	0.18	0.19
query5	0.45	0.43	0.43
query6	1.43	0.66	0.67
query7	0.02	0.02	0.01
query8	0.05	0.03	0.04
query9	0.58	0.52	0.50
query10	0.57	0.56	0.56
query11	0.15	0.10	0.11
query12	0.15	0.11	0.12
query13	0.61	0.60	0.60
query14	0.79	0.80	0.81
query15	0.87	0.84	0.87
query16	0.39	0.38	0.39
query17	1.06	1.06	1.03
query18	0.22	0.21	0.21
query19	1.93	1.85	1.84
query20	0.01	0.02	0.01
query21	15.40	0.90	0.56
query22	0.75	1.24	0.69
query23	14.84	1.36	0.61
query24	6.76	1.38	1.00
query25	0.49	0.20	0.09
query26	0.51	0.16	0.14
query27	0.05	0.05	0.05
query28	10.30	0.93	0.46
query29	12.60	4.07	3.32
query30	0.25	0.09	0.08
query31	2.82	0.61	0.40
query32	3.23	0.56	0.46
query33	3.12	3.02	3.13
query34	15.79	5.08	4.47
query35	4.54	4.52	4.50
query36	0.67	0.50	0.48
query37	0.09	0.07	0.06
query38	0.06	0.04	0.03
query39	0.03	0.02	0.03
query40	0.16	0.13	0.13
query41	0.08	0.03	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.02
Total cold run time: 103.92 s
Total hot run time: 29.24 s

doris-robot avatar May 27 '25 08:05 doris-robot

run buildall

zhaorongsheng avatar May 28 '25 06:05 zhaorongsheng

Cloud UT Coverage Report

Increment line coverage 22.45% (11/49) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 83.25% (1113/1337)
Line Coverage 66.13% (18684/28255)
Region Coverage 65.75% (9278/14111)
Branch Coverage 55.55% (4995/8992)

doris-robot avatar May 28 '25 06:05 doris-robot

run buildall

zhaorongsheng avatar May 28 '25 06:05 zhaorongsheng

Cloud UT Coverage Report

Increment line coverage 22.45% (11/49) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 83.25% (1113/1337)
Line Coverage 66.10% (18677/28255)
Region Coverage 65.72% (9274/14111)
Branch Coverage 55.45% (4986/8992)

doris-robot avatar May 28 '25 06:05 doris-robot

TPC-H: Total hot run time: 33693 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1be1ff278d1480a5c4782ce291c86efcdf9d457a, data reload: false

------ Round 1 ----------------------------------
q1	26152	5018	4933	4933
q2	2066	293	189	189
q3	10369	1221	696	696
q4	10219	1000	514	514
q5	7537	2361	2329	2329
q6	183	161	132	132
q7	893	735	604	604
q8	9314	1311	1055	1055
q9	6805	5088	5110	5088
q10	6854	2288	1894	1894
q11	470	297	285	285
q12	346	341	212	212
q13	17770	3618	3042	3042
q14	234	243	225	225
q15	549	496	497	496
q16	410	453	388	388
q17	621	856	374	374
q18	7465	7187	7133	7133
q19	2179	954	575	575
q20	348	325	222	222
q21	3655	3192	2336	2336
q22	1037	993	971	971
Total cold run time: 115476 ms
Total hot run time: 33693 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5226	5053	5023	5023
q2	235	325	227	227
q3	2135	2651	2275	2275
q4	1294	1748	1343	1343
q5	4447	4378	4432	4378
q6	219	172	131	131
q7	2012	1955	1794	1794
q8	2574	2600	2470	2470
q9	7355	7256	6966	6966
q10	3061	3186	2731	2731
q11	583	510	498	498
q12	658	801	628	628
q13	3519	3885	3282	3282
q14	297	312	278	278
q15	524	477	479	477
q16	461	498	426	426
q17	1123	1526	1403	1403
q18	7948	7624	7426	7426
q19	777	849	1036	849
q20	2001	2062	1853	1853
q21	4675	4515	4384	4384
q22	1083	1075	1064	1064
Total cold run time: 52207 ms
Total hot run time: 49906 ms

doris-robot avatar May 28 '25 08:05 doris-robot

TPC-DS: Total hot run time: 192510 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1be1ff278d1480a5c4782ce291c86efcdf9d457a, data reload: false

query1	1439	1074	1068	1068
query2	6317	1769	1773	1769
query3	11005	4631	4592	4592
query4	54263	26249	23013	23013
query5	5091	521	473	473
query6	349	203	208	203
query7	4905	491	298	298
query8	325	261	234	234
query9	5765	2638	2637	2637
query10	451	323	274	274
query11	15039	14962	14821	14821
query12	164	110	105	105
query13	1055	523	425	425
query14	10182	6253	6188	6188
query15	202	200	178	178
query16	7031	620	482	482
query17	1084	712	571	571
query18	1549	421	299	299
query19	194	192	168	168
query20	128	121	121	121
query21	207	121	111	111
query22	4394	4501	4405	4405
query23	34513	33570	33534	33534
query24	6695	2413	2387	2387
query25	455	466	405	405
query26	691	263	157	157
query27	2232	533	352	352
query28	3199	2210	2166	2166
query29	573	559	433	433
query30	275	221	202	202
query31	859	881	781	781
query32	96	65	64	64
query33	470	372	303	303
query34	766	869	526	526
query35	791	824	748	748
query36	956	1007	876	876
query37	111	99	79	79
query38	4311	4361	4177	4177
query39	1587	1468	1467	1467
query40	208	119	122	119
query41	61	54	54	54
query42	136	118	110	110
query43	498	508	454	454
query44	1320	846	823	823
query45	186	170	166	166
query46	839	1040	653	653
query47	1870	1888	1851	1851
query48	390	429	327	327
query49	698	501	428	428
query50	663	695	416	416
query51	4230	4274	4211	4211
query52	111	116	108	108
query53	230	266	186	186
query54	590	577	535	535
query55	87	88	92	88
query56	336	299	297	297
query57	1196	1193	1130	1130
query58	264	263	265	263
query59	2591	2666	2631	2631
query60	346	334	336	334
query61	161	157	151	151
query62	736	726	693	693
query63	231	195	191	191
query64	1595	1011	702	702
query65	4344	4238	4265	4238
query66	728	406	302	302
query67	16144	15783	15788	15783
query68	6811	878	529	529
query69	555	304	269	269
query70	1192	1137	1096	1096
query71	511	324	314	314
query72	5918	4767	4797	4767
query73	1491	648	426	426
query74	9009	9135	8643	8643
query75	3918	3166	2625	2625
query76	4196	1178	740	740
query77	644	365	276	276
query78	10057	10165	9369	9369
query79	2495	826	579	579
query80	653	518	451	451
query81	497	253	219	219
query82	441	127	94	94
query83	365	267	233	233
query84	319	111	90	90
query85	777	347	307	307
query86	388	296	290	290
query87	4363	4501	4326	4326
query88	3982	2313	2274	2274
query89	402	318	279	279
query90	1810	208	199	199
query91	144	148	112	112
query92	73	62	56	56
query93	2152	931	595	595
query94	660	413	293	293
query95	382	293	281	281
query96	488	569	281	281
query97	2742	2732	2672	2672
query98	230	223	205	205
query99	1411	1400	1284	1284
Total cold run time: 299584 ms
Total hot run time: 192510 ms

doris-robot avatar May 28 '25 08:05 doris-robot

ClickBench: Total hot run time: 29.21 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1be1ff278d1480a5c4782ce291c86efcdf9d457a, data reload: false

query1	0.04	0.03	0.03
query2	0.13	0.10	0.11
query3	0.25	0.19	0.19
query4	1.59	0.20	0.10
query5	0.42	0.40	0.41
query6	1.18	0.67	0.66
query7	0.03	0.02	0.02
query8	0.05	0.03	0.03
query9	0.58	0.50	0.51
query10	0.58	0.58	0.58
query11	0.16	0.11	0.11
query12	0.14	0.11	0.11
query13	0.61	0.60	0.60
query14	0.78	0.80	0.81
query15	0.88	0.85	0.87
query16	0.38	0.38	0.38
query17	1.03	1.04	1.02
query18	0.22	0.21	0.21
query19	1.95	1.82	1.91
query20	0.01	0.01	0.01
query21	15.39	0.93	0.55
query22	0.75	1.13	0.65
query23	15.00	1.38	0.65
query24	6.94	1.62	1.16
query25	0.52	0.22	0.06
query26	0.48	0.16	0.13
query27	0.05	0.05	0.05
query28	9.65	0.87	0.44
query29	12.53	3.91	3.28
query30	0.26	0.09	0.07
query31	2.81	0.60	0.39
query32	3.23	0.54	0.48
query33	3.07	3.08	3.03
query34	15.81	5.05	4.48
query35	4.50	4.52	4.46
query36	0.65	0.50	0.48
query37	0.08	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.13	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 103.14 s
Total hot run time: 29.21 s

doris-robot avatar May 28 '25 08:05 doris-robot

run buildall

yiguolei avatar May 30 '25 01:05 yiguolei

Cloud UT Coverage Report

Increment line coverage 22.45% (11/49) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 83.26% (1114/1338)
Line Coverage 66.43% (18813/28318)
Region Coverage 66.00% (9326/14130)
Branch Coverage 55.97% (5038/9002)

hello-stephen avatar May 30 '25 01:05 hello-stephen

TPC-H: Total hot run time: 33415 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 708c068f3e54bb66e72ecb7513fc8c294eadd95c, data reload: false

------ Round 1 ----------------------------------
q1	26122	4961	4989	4961
q2	1953	272	170	170
q3	10306	1223	686	686
q4	10218	996	515	515
q5	7538	2343	2345	2343
q6	183	173	134	134
q7	890	726	612	612
q8	9316	1266	1015	1015
q9	6899	5154	5018	5018
q10	6801	2315	1909	1909
q11	483	290	273	273
q12	350	349	213	213
q13	17756	3642	3089	3089
q14	243	239	218	218
q15	574	480	499	480
q16	422	427	382	382
q17	588	858	342	342
q18	7467	7146	7027	7027
q19	1235	955	558	558
q20	346	328	220	220
q21	3736	3160	2305	2305
q22	1054	1019	945	945
Total cold run time: 114480 ms
Total hot run time: 33415 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5052	5081	5060	5060
q2	232	314	224	224
q3	2116	2621	2306	2306
q4	1377	1761	1354	1354
q5	4315	4349	4350	4349
q6	217	171	125	125
q7	1989	1934	1745	1745
q8	2556	2507	2585	2507
q9	7178	7238	7039	7039
q10	3008	3187	2762	2762
q11	581	518	485	485
q12	681	755	608	608
q13	3516	3890	3245	3245
q14	289	292	266	266
q15	512	480	478	478
q16	466	506	435	435
q17	1132	1557	1378	1378
q18	7736	7588	7518	7518
q19	789	800	958	800
q20	2002	1963	1872	1872
q21	4748	4535	4342	4342
q22	1110	1076	1022	1022
Total cold run time: 51602 ms
Total hot run time: 49920 ms

doris-robot avatar May 30 '25 02:05 doris-robot