doris icon indicating copy to clipboard operation
doris copied to clipboard

[feat](restore): enhance storage medium control

Open Ryan19929 opened this issue 2 weeks ago • 20 comments

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Background

In current Doris, storage medium (SSD/HDD) selection lacks fine-grained control:

  1. Implicit medium selection with inconsistent fallback behavior
  2. Restore operations cannot control whether to preserve or override source table's storage medium

Main Changes

FE:

  • DataProperty.java: Add MediumAllocationMode enum
  • RestoreCommand.java: Support new properties
  • RestoreJob.java: Integrate medium decision logic
  • MediumDecisionMaker.java: Centralized medium selection (new)
  • SystemInfoService.java: Support allocation mode in backend selection
  • TableProperty.java: Persist medium_allocation_mode
  • FrontendService.thrift: Add new RPC fields

BE:

  • config.cpp/h: Add enable_storage_medium_fallback for runtime fallback
  • storage_engine.cpp: Support fallback logic

Usage Examples

-- Create with strict mode
CREATE TABLE t1 (...) PROPERTIES (
    'storage_medium' = 'ssd',
    'medium_allocation_mode' = 'strict'
);

-- Restore preserving source medium
RESTORE SNAPSHOT db1.snap FROM repo PROPERTIES (
    'backup_timestamp' = '...',
    'storage_medium' = 'same_with_upstream',
    'medium_allocation_mode' = 'adaptive'
);

Release note

None

Check List (For Author)

  • Test

    • [ ] Regression test
    • [ ] Unit Test
    • [ ] Manual test (add detailed scripts or steps below)
    • [ ] No need to test or manual test. Explain why:
      • [ ] This is a refactor/code format and no logic has been changed.
      • [ ] Previous test can cover this change.
      • [ ] No code files have been changed.
      • [ ] Other reason
  • Behavior changed:

    • [ ] No.
    • [ ] Yes.
  • Does this need documentation?

    • [ ] No.
    • [x] Yes. https://github.com/apache/doris-website/pull/2701

Check List (For Reviewer who merge this PR)

  • [ ] Confirm the release note
  • [ ] Confirm test cases
  • [ ] Confirm document
  • [ ] Add branch pick label

Ryan19929 avatar Dec 10 '25 07:12 Ryan19929

run buildall

Ryan19929 avatar Dec 10 '25 07:12 Ryan19929

Cloud UT Coverage Report

Increment line coverage :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 79.82% (1728/2165)
Line Coverage 65.94% (30590/46390)
Region Coverage 66.63% (15258/22900)
Branch Coverage 56.95% (8115/14250)

hello-stephen avatar Dec 10 '25 08:12 hello-stephen

FE UT Coverage Report

Increment line coverage 33.13% (161/486) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 10 '25 09:12 hello-stephen

TPC-H: Total hot run time: 36623 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6f78c73a37d9227124a04c937d2a38a2019e1973, data reload: false

------ Round 1 ----------------------------------
q1	17607	4191	4066	4066
q2	2005	341	236	236
q3	10234	1325	737	737
q4	10223	854	317	317
q5	7956	2210	1905	1905
q6	245	172	140	140
q7	1012	864	718	718
q8	9368	1474	1140	1140
q9	7193	5335	5400	5335
q10	6875	2405	1969	1969
q11	518	312	308	308
q12	734	756	631	631
q13	17808	3672	3059	3059
q14	305	300	277	277
q15	602	528	515	515
q16	950	927	861	861
q17	716	822	538	538
q18	7527	7898	7801	7801
q19	1537	1003	625	625
q20	414	372	251	251
q21	4574	4257	4143	4143
q22	1142	1064	1051	1051
Total cold run time: 109545 ms
Total hot run time: 36623 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4412	4293	4323	4293
q2	338	411	332	332
q3	2494	2838	2494	2494
q4	1403	1864	1445	1445
q5	4721	4475	4474	4474
q6	214	171	126	126
q7	1999	1884	1781	1781
q8	2670	2573	2552	2552
q9	7662	7599	7154	7154
q10	2908	3133	2629	2629
q11	564	485	474	474
q12	625	712	548	548
q13	3314	3630	2985	2985
q14	272	284	259	259
q15	532	503	495	495
q16	841	884	844	844
q17	1128	1353	1385	1353
q18	7318	7105	7147	7105
q19	814	785	829	785
q20	1909	1990	1841	1841
q21	4627	4265	4155	4155
q22	1104	1028	1003	1003
Total cold run time: 51869 ms
Total hot run time: 49127 ms

doris-robot avatar Dec 10 '25 10:12 doris-robot

TPC-DS: Total hot run time: 182217 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6f78c73a37d9227124a04c937d2a38a2019e1973, data reload: false

query5	4541	630	493	493
query6	332	238	227	227
query7	4229	479	293	293
query8	315	268	251	251
query9	8799	2577	2595	2577
query10	551	405	343	343
query11	15061	15200	15203	15200
query12	198	122	119	119
query13	1271	517	402	402
query14	6643	3272	3015	3015
query14_1	2934	2894	2958	2894
query15	208	200	182	182
query16	804	479	465	465
query17	1148	738	610	610
query18	2700	450	358	358
query19	241	242	215	215
query20	128	119	115	115
query21	223	144	118	118
query22	3898	4004	3877	3877
query23	16643	16054	16062	16054
query23_1	16127	16105	16047	16047
query24	7416	1668	1278	1278
query24_1	1242	1257	1248	1248
query25	566	501	470	470
query26	1263	273	167	167
query27	2733	463	323	323
query28	4448	2160	2148	2148
query29	846	537	443	443
query30	319	251	215	215
query31	856	703	613	613
query32	86	70	72	70
query33	533	330	296	296
query34	904	896	554	554
query35	778	832	733	733
query36	864	902	824	824
query37	137	96	79	79
query38	3889	3872	3764	3764
query39	753	754	707	707
query39_1	692	694	719	694
query40	228	139	128	128
query41	70	63	60	60
query42	112	110	108	108
query43	429	424	395	395
query44	1360	752	751	751
query45	194	194	183	183
query46	891	980	637	637
query47	1667	1707	1611	1611
query48	310	323	246	246
query49	627	437	355	355
query50	672	302	227	227
query51	3908	3816	3889	3816
query52	112	108	102	102
query53	343	359	293	293
query54	301	266	249	249
query55	78	77	69	69
query56	300	298	329	298
query57	1131	1136	1072	1072
query58	270	254	253	253
query59	2298	2466	2316	2316
query60	310	315	293	293
query61	163	155	153	153
query62	703	671	650	650
query63	327	297	299	297
query64	4918	1320	1020	1020
query65	4027	3953	3952	3952
query66	1382	448	344	344
query67	15372	14821	14600	14600
query68	8292	1012	748	748
query69	485	345	306	306
query70	1105	1002	1015	1002
query71	366	322	287	287
query72	6082	5097	5248	5097
query73	727	682	311	311
query74	8893	8812	8677	8677
query75	3600	3514	3181	3181
query76	4059	1159	773	773
query77	547	401	304	304
query78	9369	9662	8900	8900
query79	1727	845	630	630
query80	721	653	556	556
query81	516	275	236	236
query82	202	139	108	108
query83	266	263	245	245
query84	256	124	109	109
query85	915	516	473	473
query86	379	299	302	299
query87	4018	4133	4005	4005
query88	3323	2292	2305	2292
query89	476	438	407	407
query90	2204	179	148	148
query91	177	171	146	146
query92	81	72	67	67
query93	2329	933	566	566
query94	466	303	271	271
query95	600	327	313	313
query96	584	473	212	212
query97	2626	2648	2574	2574
query98	219	197	192	192
query99	1369	1307	1223	1223
Total cold run time: 264878 ms
Total hot run time: 182217 ms

doris-robot avatar Dec 10 '25 10:12 doris-robot

ClickBench: Total hot run time: 28.28 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6f78c73a37d9227124a04c937d2a38a2019e1973, data reload: false

query1	0.05	0.05	0.04
query2	0.14	0.07	0.06
query3	0.30	0.08	0.07
query4	1.61	0.10	0.10
query5	0.26	0.24	0.25
query6	1.17	0.64	0.63
query7	0.04	0.03	0.03
query8	0.07	0.06	0.06
query9	0.58	0.51	0.50
query10	0.56	0.58	0.55
query11	0.26	0.13	0.14
query12	0.26	0.14	0.14
query13	0.64	0.65	0.61
query14	1.01	1.01	1.01
query15	0.89	0.84	0.81
query16	0.40	0.37	0.43
query17	0.98	0.96	0.97
query18	0.24	0.22	0.22
query19	1.97	1.85	1.84
query20	0.02	0.02	0.01
query21	15.44	0.29	0.24
query22	4.98	0.10	0.09
query23	15.41	0.41	0.22
query24	2.41	0.44	0.29
query25	0.10	0.09	0.09
query26	0.18	0.18	0.18
query27	0.10	0.09	0.09
query28	3.71	1.37	1.15
query29	12.56	4.09	3.29
query30	0.32	0.13	0.10
query31	2.81	0.64	0.43
query32	3.25	0.60	0.48
query33	3.07	3.04	3.11
query34	16.78	5.19	4.62
query35	4.68	4.74	4.61
query36	0.62	0.49	0.48
query37	0.27	0.09	0.09
query38	0.19	0.06	0.06
query39	0.07	0.05	0.05
query40	0.19	0.16	0.17
query41	0.13	0.06	0.05
query42	0.08	0.05	0.04
query43	0.07	0.05	0.05
Total cold run time: 98.87 s
Total hot run time: 28.28 s

doris-robot avatar Dec 10 '25 10:12 doris-robot

BE UT Coverage Report

Increment line coverage 100.00% (30/30) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 53.36% (18717/35078)
Line Coverage 39.06% (173083/443106)
Region Coverage 33.76% (134327/397915)
Branch Coverage 34.67% (57723/166514)

doris-robot avatar Dec 10 '25 11:12 doris-robot

BE Regression && UT Coverage Report

Increment line coverage 100.00% (30/30) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 73.06% (25117/34380)
Line Coverage 60.23% (266595/442630)
Region Coverage 55.97% (225372/402638)
Branch Coverage 57.12% (95611/167389)

hello-stephen avatar Dec 10 '25 13:12 hello-stephen

FE Regression Coverage Report

Increment line coverage 40.74% (198/486) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 10 '25 14:12 hello-stephen

run feut

Ryan19929 avatar Dec 11 '25 02:12 Ryan19929

run p0

Ryan19929 avatar Dec 11 '25 05:12 Ryan19929

run buildall

Ryan19929 avatar Dec 11 '25 06:12 Ryan19929

Cloud UT Coverage Report

Increment line coverage :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 79.82% (1728/2165)
Line Coverage 65.92% (30578/46390)
Region Coverage 66.63% (15259/22900)
Branch Coverage 56.89% (8107/14250)

hello-stephen avatar Dec 11 '25 07:12 hello-stephen

FE UT Coverage Report

Increment line coverage 32.02% (154/481) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 11 '25 08:12 hello-stephen

TPC-H: Total hot run time: 35526 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 792260b13e371e2a17a046cc66c71c673a1f27eb, data reload: false

------ Round 1 ----------------------------------
q1	17632	4321	4172	4172
q2	2035	356	247	247
q3	10405	1317	742	742
q4	10326	823	315	315
q5	9413	2192	1951	1951
q6	217	168	136	136
q7	1024	873	718	718
q8	9353	1488	1203	1203
q9	7382	5278	5386	5278
q10	6878	2417	1997	1997
q11	534	322	317	317
q12	734	754	583	583
q13	17788	3707	3078	3078
q14	295	298	264	264
q15	581	515	517	515
q16	941	921	873	873
q17	720	862	483	483
q18	8288	7162	7150	7150
q19	1132	974	615	615
q20	418	363	244	244
q21	4338	4048	3685	3685
q22	1047	1006	960	960
Total cold run time: 111481 ms
Total hot run time: 35526 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4154	4162	4068	4068
q2	334	405	323	323
q3	2176	2687	2271	2271
q4	1354	1777	1313	1313
q5	4788	4740	4611	4611
q6	213	165	127	127
q7	2053	1886	1856	1856
q8	2734	2532	2560	2532
q9	7618	7554	7447	7447
q10	3107	3237	3010	3010
q11	597	521	483	483
q12	693	767	569	569
q13	3804	3894	3406	3406
q14	285	331	265	265
q15	567	528	530	528
q16	963	922	878	878
q17	1258	1548	1413	1413
q18	7887	7734	7601	7601
q19	945	895	897	895
q20	1950	1966	1865	1865
q21	4729	4242	4169	4169
q22	1076	1032	974	974
Total cold run time: 53285 ms
Total hot run time: 50604 ms

doris-robot avatar Dec 11 '25 09:12 doris-robot

TPC-DS: Total hot run time: 181839 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 792260b13e371e2a17a046cc66c71c673a1f27eb, data reload: false

query5	5209	637	478	478
query6	335	235	214	214
query7	4221	483	277	277
query8	303	251	237	237
query9	8793	2578	2583	2578
query10	550	381	321	321
query11	15800	15335	15163	15163
query12	188	115	117	115
query13	1262	497	373	373
query14	6414	3316	2993	2993
query14_1	2935	2884	2960	2884
query15	216	204	183	183
query16	831	480	441	441
query17	1089	712	579	579
query18	2682	431	346	346
query19	232	240	208	208
query20	124	115	111	111
query21	218	133	113	113
query22	3811	3892	3823	3823
query23	16496	16188	15877	15877
query23_1	16142	16069	15948	15948
query24	7340	1665	1227	1227
query24_1	1226	1220	1260	1220
query25	547	457	434	434
query26	1246	273	162	162
query27	2767	463	303	303
query28	4476	2169	2129	2129
query29	808	548	437	437
query30	321	247	226	226
query31	848	716	621	621
query32	77	72	72	72
query33	553	332	279	279
query34	902	923	538	538
query35	782	840	732	732
query36	866	912	828	828
query37	126	91	84	84
query38	3884	3892	3894	3892
query39	784	735	728	728
query39_1	706	695	701	695
query40	222	136	122	122
query41	69	63	64	63
query42	106	103	107	103
query43	436	429	403	403
query44	1359	762	755	755
query45	198	194	184	184
query46	876	986	634	634
query47	1671	1688	1611	1611
query48	316	324	249	249
query49	653	438	358	358
query50	650	298	221	221
query51	3782	3816	3806	3806
query52	108	111	99	99
query53	322	339	298	298
query54	294	272	283	272
query55	81	76	72	72
query56	291	302	295	295
query57	1146	1131	1070	1070
query58	271	255	254	254
query59	2307	2454	2380	2380
query60	325	329	315	315
query61	188	180	188	180
query62	723	669	633	633
query63	334	300	307	300
query64	5074	1368	1017	1017
query65	3998	3952	3964	3952
query66	1376	450	341	341
query67	15120	14963	14833	14833
query68	3078	1073	774	774
query69	506	350	306	306
query70	1084	1011	987	987
query71	346	311	284	284
query72	6000	4999	5138	4999
query73	536	567	314	314
query74	8706	8848	8517	8517
query75	3572	3561	3202	3202
query76	3615	1148	759	759
query77	548	389	312	312
query78	9514	9739	8885	8885
query79	1004	880	616	616
query80	1145	684	605	605
query81	569	273	244	244
query82	435	135	108	108
query83	280	261	250	250
query84	263	123	106	106
query85	1078	509	470	470
query86	359	303	302	302
query87	4010	4228	4001	4001
query88	3229	2316	2310	2310
query89	465	457	390	390
query90	1934	174	156	156
query91	177	171	149	149
query92	68	69	65	65
query93	1047	916	572	572
query94	574	299	283	283
query95	575	329	366	329
query96	600	454	211	211
query97	2622	2632	2579	2579
query98	207	195	201	195
query99	1275	1290	1204	1204
Total cold run time: 257841 ms
Total hot run time: 181839 ms

doris-robot avatar Dec 11 '25 09:12 doris-robot

ClickBench: Total hot run time: 28.49 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 792260b13e371e2a17a046cc66c71c673a1f27eb, data reload: false

query1	0.05	0.05	0.04
query2	0.13	0.07	0.07
query3	0.31	0.08	0.08
query4	1.61	0.10	0.10
query5	0.26	0.25	0.25
query6	1.19	0.66	0.64
query7	0.03	0.03	0.03
query8	0.07	0.06	0.06
query9	0.59	0.50	0.50
query10	0.57	0.57	0.56
query11	0.26	0.13	0.14
query12	0.25	0.14	0.14
query13	0.64	0.63	0.60
query14	1.01	1.01	1.02
query15	0.90	0.82	0.83
query16	0.40	0.39	0.40
query17	1.05	1.06	1.07
query18	0.23	0.22	0.22
query19	1.98	1.84	1.86
query20	0.02	0.01	0.02
query21	15.40	0.28	0.23
query22	4.98	0.09	0.10
query23	15.39	0.40	0.22
query24	2.40	0.48	0.32
query25	0.10	0.09	0.10
query26	0.18	0.18	0.19
query27	0.09	0.09	0.10
query28	3.71	1.34	1.16
query29	12.58	4.16	3.36
query30	0.33	0.13	0.11
query31	2.82	0.63	0.43
query32	3.24	0.59	0.50
query33	3.01	2.99	3.14
query34	16.67	5.20	4.62
query35	4.75	4.57	4.73
query36	0.62	0.52	0.48
query37	0.24	0.09	0.08
query38	0.21	0.06	0.05
query39	0.07	0.05	0.05
query40	0.20	0.18	0.16
query41	0.13	0.06	0.06
query42	0.07	0.06	0.05
query43	0.06	0.06	0.05
Total cold run time: 98.8 s
Total hot run time: 28.49 s

doris-robot avatar Dec 11 '25 09:12 doris-robot

BE UT Coverage Report

Increment line coverage 100.00% (30/30) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 53.36% (18764/35165)
Line Coverage 39.11% (173543/443704)
Region Coverage 33.80% (134613/398245)
Branch Coverage 34.73% (57884/166661)

hello-stephen avatar Dec 11 '25 10:12 hello-stephen

BE Regression && UT Coverage Report

Increment line coverage 100.00% (30/30) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 72.27% (24911/34467)
Line Coverage 59.02% (261608/443228)
Region Coverage 54.03% (217741/402968)
Branch Coverage 55.51% (92997/167536)

hello-stephen avatar Dec 11 '25 10:12 hello-stephen

FE Regression Coverage Report

Increment line coverage 42.20% (203/481) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 11 '25 10:12 hello-stephen

run buildall

Ryan19929 avatar Dec 12 '25 01:12 Ryan19929

Cloud UT Coverage Report

Increment line coverage :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 79.83% (1730/2167)
Line Coverage 65.86% (30607/46476)
Region Coverage 66.58% (15270/22934)
Branch Coverage 56.89% (8116/14266)

hello-stephen avatar Dec 12 '25 02:12 hello-stephen

TPC-H: Total hot run time: 36834 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2c30e08fcd3bb3cd050152eb5b790e4b39aead13, data reload: false

------ Round 1 ----------------------------------
q1	17663	4221	4216	4216
q2	2040	366	237	237
q3	10433	1345	766	766
q4	10338	800	315	315
q5	9765	2099	2035	2035
q6	246	170	135	135
q7	1028	865	708	708
q8	9365	1378	1203	1203
q9	7255	5439	5398	5398
q10	6890	2385	2015	2015
q11	551	328	281	281
q12	739	716	595	595
q13	17825	3678	3086	3086
q14	286	315	272	272
q15	597	520	518	518
q16	915	936	872	872
q17	722	858	511	511
q18	7740	8465	7556	7556
q19	1124	1026	641	641
q20	434	392	251	251
q21	4651	4209	4234	4209
q22	1120	1099	1014	1014
Total cold run time: 111727 ms
Total hot run time: 36834 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4371	4268	4460	4268
q2	319	398	342	342
q3	2338	2894	2697	2697
q4	1406	1821	1455	1455
q5	4594	4511	4457	4457
q6	214	168	127	127
q7	2155	1965	1841	1841
q8	2669	2590	2621	2590
q9	7671	7404	7022	7022
q10	2926	3103	2695	2695
q11	560	489	467	467
q12	648	681	564	564
q13	3243	3682	3021	3021
q14	279	276	253	253
q15	528	495	493	493
q16	859	873	840	840
q17	1162	1451	1368	1368
q18	7244	7086	7141	7086
q19	867	814	837	814
q20	1932	1993	1807	1807
q21	4702	4349	4157	4157
q22	1136	1045	972	972
Total cold run time: 51823 ms
Total hot run time: 49336 ms

doris-robot avatar Dec 12 '25 04:12 doris-robot

TPC-DS: Total hot run time: 181614 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2c30e08fcd3bb3cd050152eb5b790e4b39aead13, data reload: false

query5	4775	606	479	479
query6	330	236	221	221
query7	4255	471	283	283
query8	319	259	249	249
query9	8798	2593	2590	2590
query10	533	400	343	343
query11	15610	15137	14553	14553
query12	192	120	120	120
query13	1277	515	391	391
query14	6476	3257	2987	2987
query14_1	2955	2967	2923	2923
query15	221	203	188	188
query16	904	463	471	463
query17	1153	739	619	619
query18	2577	449	361	361
query19	235	231	218	218
query20	125	120	115	115
query21	223	139	122	122
query22	3965	3939	4054	3939
query23	16771	16295	16322	16295
query23_1	16190	16105	16186	16105
query24	7373	1654	1222	1222
query24_1	1266	1228	1246	1228
query25	602	498	452	452
query26	1272	274	174	174
query27	2734	471	306	306
query28	4456	2159	2180	2159
query29	788	537	450	450
query30	315	247	216	216
query31	884	711	612	612
query32	79	66	69	66
query33	543	332	285	285
query34	913	887	544	544
query35	783	825	737	737
query36	850	903	823	823
query37	131	93	80	80
query38	3836	3852	3704	3704
query39	761	729	767	729
query39_1	706	700	728	700
query40	236	139	121	121
query41	69	66	63	63
query42	112	106	105	105
query43	432	417	398	398
query44	1307	751	748	748
query45	194	194	181	181
query46	879	985	607	607
query47	1689	1697	1630	1630
query48	314	326	243	243
query49	675	442	360	360
query50	675	304	229	229
query51	3884	3813	3803	3803
query52	105	107	101	101
query53	332	353	294	294
query54	291	263	260	260
query55	78	77	73	73
query56	298	304	287	287
query57	1132	1159	1089	1089
query58	276	259	253	253
query59	2417	2528	2392	2392
query60	322	318	290	290
query61	163	161	154	154
query62	697	658	637	637
query63	330	296	298	296
query64	4927	1304	1014	1014
query65	4051	3923	3955	3923
query66	1431	451	323	323
query67	15208	15155	14908	14908
query68	6492	1009	731	731
query69	498	350	319	319
query70	1115	1022	987	987
query71	357	310	293	293
query72	6040	4889	5014	4889
query73	652	558	312	312
query74	8927	8925	8618	8618
query75	3560	3545	3207	3207
query76	3910	1147	774	774
query77	527	385	302	302
query78	9467	9650	8796	8796
query79	1149	883	597	597
query80	971	646	543	543
query81	520	276	241	241
query82	409	136	103	103
query83	271	263	242	242
query84	260	126	99	99
query85	890	529	465	465
query86	345	303	282	282
query87	4134	4144	3975	3975
query88	3194	2280	2282	2280
query89	460	428	398	398
query90	1946	161	154	154
query91	178	171	148	148
query92	70	68	65	65
query93	1135	898	556	556
query94	567	303	270	270
query95	578	392	337	337
query96	615	459	209	209
query97	2590	2681	2602	2602
query98	217	193	204	193
query99	1282	1325	1203	1203
Total cold run time: 262081 ms
Total hot run time: 181614 ms

doris-robot avatar Dec 12 '25 04:12 doris-robot

ClickBench: Total hot run time: 28.42 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2c30e08fcd3bb3cd050152eb5b790e4b39aead13, data reload: false

query1	0.05	0.05	0.05
query2	0.14	0.06	0.07
query3	0.34	0.08	0.08
query4	1.61	0.11	0.10
query5	0.27	0.25	0.25
query6	1.18	0.64	0.65
query7	0.03	0.02	0.02
query8	0.08	0.06	0.06
query9	0.60	0.52	0.52
query10	0.56	0.56	0.56
query11	0.27	0.13	0.13
query12	0.26	0.14	0.14
query13	0.63	0.62	0.62
query14	1.01	0.99	1.00
query15	0.89	0.82	0.82
query16	0.40	0.39	0.39
query17	1.02	1.06	1.08
query18	0.24	0.22	0.22
query19	1.90	1.82	1.75
query20	0.02	0.02	0.01
query21	15.40	0.28	0.24
query22	4.95	0.10	0.09
query23	15.38	0.39	0.22
query24	2.46	0.47	0.34
query25	0.10	0.09	0.09
query26	0.20	0.18	0.18
query27	0.10	0.09	0.08
query28	3.98	1.37	1.15
query29	12.62	4.14	3.29
query30	0.34	0.13	0.11
query31	2.83	0.67	0.43
query32	3.25	0.60	0.49
query33	3.05	2.98	3.08
query34	16.75	5.26	4.61
query35	4.68	4.68	4.72
query36	0.62	0.50	0.49
query37	0.24	0.09	0.08
query38	0.21	0.06	0.05
query39	0.07	0.04	0.05
query40	0.21	0.18	0.16
query41	0.13	0.06	0.06
query42	0.08	0.04	0.04
query43	0.06	0.06	0.05
Total cold run time: 99.21 s
Total hot run time: 28.42 s

doris-robot avatar Dec 12 '25 04:12 doris-robot

BE UT Coverage Report

Increment line coverage 100.00% (30/30) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 53.45% (18835/35237)
Line Coverage 39.19% (174150/444400)
Region Coverage 33.84% (134890/398666)
Branch Coverage 34.78% (58053/166916)

doris-robot avatar Dec 12 '25 05:12 doris-robot

BE Regression && UT Coverage Report

Increment line coverage 100.00% (30/30) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 73.82% (25493/34534)
Line Coverage 61.20% (271674/443895)
Region Coverage 56.27% (226972/403382)
Branch Coverage 58.10% (97484/167789)

hello-stephen avatar Dec 12 '25 06:12 hello-stephen

FE Regression Coverage Report

Increment line coverage 42.20% (203/481) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 12 '25 07:12 hello-stephen

run external

Ryan19929 avatar Dec 12 '25 08:12 Ryan19929

run external

Ryan19929 avatar Dec 15 '25 00:12 Ryan19929