doris icon indicating copy to clipboard operation
doris copied to clipboard

[feature](merge-cloud) support MoW table in cloud mode

Open liaoxin01 opened this issue 1 year ago • 5 comments

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

liaoxin01 avatar Feb 23 '24 06:02 liaoxin01

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

doris-robot avatar Feb 23 '24 06:02 doris-robot

run buildall

liaoxin01 avatar Feb 23 '24 06:02 liaoxin01

TeamCity be ut coverage result: Function Coverage: 35.66% (8548/23969) Line Coverage: 27.49% (69356/252339) Region Coverage: 26.66% (35975/134959) Branch Coverage: 23.47% (18391/78358) Coverage Report: http://coverage.selectdb-in.cc/coverage/f4f246d4ac5209b17373b1d7d25eca18329f1ea8_f4f246d4ac5209b17373b1d7d25eca18329f1ea8/report/index.html

doris-robot avatar Feb 23 '24 08:02 doris-robot

run buildall

liaoxin01 avatar Feb 23 '24 11:02 liaoxin01

TeamCity be ut coverage result: Function Coverage: 35.66% (8548/23969) Line Coverage: 27.49% (69375/252334) Region Coverage: 26.67% (35985/134950) Branch Coverage: 23.48% (18395/78352) Coverage Report: http://coverage.selectdb-in.cc/coverage/414cf06f8598a980da120a66191f071fab1c4d2a_414cf06f8598a980da120a66191f071fab1c4d2a/report/index.html

doris-robot avatar Feb 23 '24 11:02 doris-robot

run buildall

liaoxin01 avatar Feb 26 '24 14:02 liaoxin01

TeamCity be ut coverage result: Function Coverage: 35.66% (8548/23968) Line Coverage: 27.48% (69389/252516) Region Coverage: 26.65% (35984/135032) Branch Coverage: 23.47% (18401/78398) Coverage Report: http://coverage.selectdb-in.cc/coverage/a6744cda842c2b05e73edbbe3e227234a3e0f785_a6744cda842c2b05e73edbbe3e227234a3e0f785/report/index.html

doris-robot avatar Feb 26 '24 15:02 doris-robot

run buildall

liaoxin01 avatar Feb 27 '24 13:02 liaoxin01

TeamCity be ut coverage result: Function Coverage: 35.64% (8548/23984) Line Coverage: 27.44% (69385/252832) Region Coverage: 26.62% (35972/135152) Branch Coverage: 23.43% (18386/78472) Coverage Report: http://coverage.selectdb-in.cc/coverage/ee84a0fb4b4a31f62ca947631bdc7ceaf39e9833_ee84a0fb4b4a31f62ca947631bdc7ceaf39e9833/report/index.html

doris-robot avatar Feb 27 '24 14:02 doris-robot

TPC-H: Total hot run time: 38013 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ee84a0fb4b4a31f62ca947631bdc7ceaf39e9833, data reload: false

------ Round 1 ----------------------------------
q1	17816	4026	4055	4026
q2	2049	141	137	137
q3	10665	956	954	954
q4	4678	954	962	954
q5	7634	2847	3054	2847
q6	180	125	120	120
q7	1251	764	765	764
q8	9321	2037	2031	2031
q9	7705	6295	6329	6295
q10	8189	2503	2507	2503
q11	413	202	209	202
q12	770	304	312	304
q13	17981	3240	3238	3238
q14	278	250	270	250
q15	535	498	495	495
q16	465	413	418	413
q17	944	902	889	889
q18	6717	5905	6020	5905
q19	1572	1516	1524	1516
q20	571	301	271	271
q21	6903	3620	3603	3603
q22	813	296	298	296
Total cold run time: 107450 ms
Total hot run time: 38013 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4029	3994	3989	3989
q2	304	230	214	214
q3	2960	2963	2923	2923
q4	1883	1820	1811	1811
q5	5151	5111	5135	5111
q6	198	116	114	114
q7	2120	1792	1725	1725
q8	3145	3212	3206	3206
q9	8257	8314	8262	8262
q10	6084	3668	3644	3644
q11	513	434	440	434
q12	677	512	517	512
q13	8772	3033	3039	3033
q14	271	250	256	250
q15	536	499	492	492
q16	519	470	466	466
q17	1715	1691	1698	1691
q18	7835	7512	7405	7405
q19	1685	1644	1625	1625
q20	2102	1915	1901	1901
q21	4773	4611	4630	4611
q22	521	455	454	454
Total cold run time: 64050 ms
Total hot run time: 53873 ms

doris-robot avatar Feb 27 '24 15:02 doris-robot

TPC-DS: Total hot run time: 169525 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ee84a0fb4b4a31f62ca947631bdc7ceaf39e9833, data reload: false

query1	959	342	342	342
query2	6534	1694	1732	1694
query3	6703	205	205	205
query4	23352	20572	20583	20572
query5	4263	359	353	353
query6	262	171	172	171
query7	4603	301	294	294
query8	269	185	214	185
query9	8448	2175	2173	2173
query10	411	219	214	214
query11	14636	14153	14070	14070
query12	137	82	84	82
query13	1643	425	424	424
query14	8569	6298	6517	6298
query15	202	173	172	172
query16	7082	269	252	252
query17	1027	528	504	504
query18	1912	285	266	266
query19	193	150	152	150
query20	86	81	84	81
query21	203	129	128	128
query22	4701	4674	4509	4509
query23	30422	29868	29861	29861
query24	11828	3155	3077	3077
query25	659	347	344	344
query26	1880	163	162	162
query27	3042	314	312	312
query28	7045	1792	1769	1769
query29	1173	562	571	562
query30	289	131	143	131
query31	869	693	699	693
query32	92	60	58	58
query33	711	235	225	225
query34	1041	484	488	484
query35	880	744	745	744
query36	941	869	873	869
query37	153	62	63	62
query38	3115	2974	2982	2974
query39	1337	1265	1258	1258
query40	287	101	100	100
query41	37	37	35	35
query42	107	96	95	95
query43	459	423	417	417
query44	1057	681	700	681
query45	187	181	173	173
query46	1056	797	767	767
query47	1551	1452	1455	1452
query48	408	345	329	329
query49	1177	301	284	284
query50	771	373	370	370
query51	4391	4254	4298	4254
query52	102	88	90	88
query53	332	267	263	263
query54	289	229	240	229
query55	82	81	78	78
query56	222	201	204	201
query57	1035	920	922	920
query58	212	196	194	194
query59	2242	2074	2159	2074
query60	242	208	218	208
query61	88	82	88	82
query62	594	367	361	361
query63	278	260	255	255
query64	6582	3073	3121	3073
query65	3238	3250	3221	3221
query66	1438	321	315	315
query67	14651	14335	14244	14244
query68	4934	559	559	559
query69	545	387	385	385
query70	1281	1259	1237	1237
query71	402	255	251	251
query72	6271	2838	2709	2709
query73	704	324	328	324
query74	6242	6055	5996	5996
query75	3040	2425	2416	2416
query76	2845	1014	1159	1014
query77	351	240	234	234
query78	9240	8599	8515	8515
query79	1041	533	550	533
query80	667	361	340	340
query81	469	198	195	195
query82	1314	88	85	85
query83	247	131	116	116
query84	283	82	76	76
query85	1173	350	342	342
query86	317	308	309	308
query87	3299	3082	3095	3082
query88	2792	2356	2340	2340
query89	399	341	344	341
query90	2045	165	163	163
query91	149	125	124	124
query92	59	48	52	48
query93	1046	525	504	504
query94	1125	178	182	178
query95	437	340	344	340
query96	571	268	265	265
query97	4278	4140	4138	4138
query98	222	204	201	201
query99	1033	679	707	679
Total cold run time: 263608 ms
Total hot run time: 169525 ms

doris-robot avatar Feb 27 '24 15:02 doris-robot

ClickBench: Total hot run time: 32.3 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ee84a0fb4b4a31f62ca947631bdc7ceaf39e9833, data reload: false

query1	0.04	0.03	0.04
query2	0.06	0.03	0.02
query3	0.24	0.06	0.06
query4	1.66	0.10	0.10
query5	0.52	0.52	0.52
query6	1.29	0.66	0.71
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.56	0.52	0.51
query10	0.58	0.59	0.57
query11	0.12	0.10	0.09
query12	0.13	0.10	0.10
query13	0.62	0.62	0.61
query14	0.79	0.81	0.80
query15	0.84	0.82	0.82
query16	0.40	0.37	0.40
query17	1.00	0.97	1.01
query18	0.27	0.24	0.24
query19	1.80	1.74	1.68
query20	0.02	0.01	0.01
query21	15.40	0.64	0.65
query22	3.26	3.42	2.56
query23	17.86	1.04	0.94
query24	2.01	0.56	0.37
query25	0.46	0.16	0.05
query26	0.17	0.15	0.16
query27	0.06	0.06	0.04
query28	12.04	0.83	0.84
query29	12.50	3.28	3.23
query30	0.60	0.55	0.52
query31	2.79	0.34	0.35
query32	3.36	0.48	0.48
query33	3.20	3.18	3.20
query34	15.36	4.73	4.73
query35	4.74	4.76	4.73
query36	1.14	1.07	1.07
query37	0.06	0.04	0.05
query38	0.05	0.03	0.02
query39	0.02	0.01	0.02
query40	0.17	0.13	0.13
query41	0.08	0.02	0.01
query42	0.02	0.01	0.02
query43	0.03	0.02	0.02
Total cold run time: 106.38 s
Total hot run time: 32.3 s

doris-robot avatar Feb 27 '24 15:02 doris-robot

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit ee84a0fb4b4a31f62ca947631bdc7ceaf39e9833 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       17.9 seconds inserted 10000000 Rows, about 558K ops/s

doris-robot avatar Feb 27 '24 15:02 doris-robot

run buildall

liaoxin01 avatar Feb 28 '24 09:02 liaoxin01

run buildall

liaoxin01 avatar Feb 28 '24 09:02 liaoxin01

run buildall

liaoxin01 avatar Feb 28 '24 09:02 liaoxin01

TPC-H: Total hot run time: 38282 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 79b90d0e6d1ee594376d460be1d722f84c24b1e8, data reload: false

------ Round 1 ----------------------------------
q1	18929	4301	4174	4174
q2	2384	152	140	140
q3	11459	973	978	973
q4	5076	975	970	970
q5	8295	2986	3011	2986
q6	185	131	128	128
q7	1250	773	754	754
q8	9351	1958	2047	1958
q9	7199	6354	6385	6354
q10	8935	2564	2507	2507
q11	412	202	220	202
q12	788	318	313	313
q13	17966	3209	3215	3209
q14	294	256	258	256
q15	534	514	495	495
q16	485	421	417	417
q17	963	899	866	866
q18	6414	5954	6094	5954
q19	1736	1523	1533	1523
q20	500	284	275	275
q21	5648	3579	3542	3542
q22	613	304	286	286
Total cold run time: 109416 ms
Total hot run time: 38282 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4042	4071	4067	4067
q2	308	222	222	222
q3	2990	2955	2945	2945
q4	1866	1811	1830	1811
q5	5105	5159	5136	5136
q6	200	116	118	116
q7	2177	1774	1730	1730
q8	3167	3218	3225	3218
q9	8315	8265	8284	8265
q10	4487	3658	3647	3647
q11	521	418	429	418
q12	710	526	530	526
q13	3738	3095	3066	3066
q14	269	260	267	260
q15	534	499	496	496
q16	519	496	467	467
q17	1705	1705	1695	1695
q18	7845	7603	7464	7464
q19	1673	1678	1662	1662
q20	2092	1912	1884	1884
q21	4812	4714	4648	4648
q22	514	450	422	422
Total cold run time: 57589 ms
Total hot run time: 54165 ms

doris-robot avatar Feb 28 '24 10:02 doris-robot

TPC-DS: Total hot run time: 169427 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 79b90d0e6d1ee594376d460be1d722f84c24b1e8, data reload: false

query1	932	338	346	338
query2	6524	1739	1829	1739
query3	6705	210	209	209
query4	23339	20584	20475	20475
query5	4244	357	357	357
query6	264	173	169	169
query7	4599	302	303	302
query8	268	191	184	184
query9	8393	2251	2252	2251
query10	422	225	215	215
query11	14672	14391	14121	14121
query12	130	83	84	83
query13	1658	433	432	432
query14	8835	6473	6437	6437
query15	206	175	177	175
query16	7086	264	253	253
query17	1032	523	518	518
query18	1912	265	262	262
query19	192	152	150	150
query20	85	83	82	82
query21	199	127	115	115
query22	4762	4607	4564	4564
query23	30659	29929	29840	29840
query24	11962	3138	3060	3060
query25	655	360	346	346
query26	1841	155	155	155
query27	3020	309	314	309
query28	7002	1822	1798	1798
query29	1163	573	572	572
query30	290	130	139	130
query31	871	702	694	694
query32	99	59	63	59
query33	728	231	215	215
query34	1046	489	489	489
query35	866	754	755	754
query36	898	904	838	838
query37	126	62	62	62
query38	3071	2968	2959	2959
query39	1319	1261	1247	1247
query40	276	102	97	97
query41	38	38	35	35
query42	104	97	102	97
query43	465	433	431	431
query44	1065	701	714	701
query45	192	178	175	175
query46	1043	803	810	803
query47	1565	1469	1465	1465
query48	422	352	348	348
query49	1174	288	297	288
query50	771	378	382	378
query51	4380	4287	4293	4287
query52	104	91	92	91
query53	343	270	270	270
query54	302	233	224	224
query55	89	79	85	79
query56	213	201	191	191
query57	949	883	885	883
query58	207	199	189	189
query59	2228	2149	2105	2105
query60	231	214	207	207
query61	83	82	86	82
query62	595	364	357	357
query63	277	263	271	263
query64	6578	3027	3112	3027
query65	3242	3236	3210	3210
query66	1441	326	316	316
query67	14338	14257	13985	13985
query68	4459	577	568	568
query69	535	383	379	379
query70	1224	1203	1254	1203
query71	329	251	247	247
query72	6034	2808	2646	2646
query73	708	325	323	323
query74	6343	6046	6012	6012
query75	3096	2448	2400	2400
query76	2660	1085	1175	1085
query77	342	240	241	240
query78	8884	8627	8402	8402
query79	1296	547	546	546
query80	1003	369	342	342
query81	469	197	198	197
query82	951	81	86	81
query83	227	123	120	120
query84	286	81	78	78
query85	1327	357	345	345
query86	398	300	308	300
query87	3257	3104	3095	3095
query88	2830	2391	2371	2371
query89	409	336	342	336
query90	1839	168	169	168
query91	156	126	123	123
query92	54	49	47	47
query93	1201	509	504	504
query94	1235	178	179	178
query95	440	339	342	339
query96	575	267	274	267
query97	4294	4119	4170	4119
query98	218	197	196	196
query99	1129	677	628	628
Total cold run time: 262998 ms
Total hot run time: 169427 ms

doris-robot avatar Feb 28 '24 11:02 doris-robot

ClickBench: Total hot run time: 33.4 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 79b90d0e6d1ee594376d460be1d722f84c24b1e8, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.02	0.02
query3	0.23	0.06	0.06
query4	1.67	0.10	0.10
query5	0.52	0.52	0.52
query6	1.24	0.68	0.68
query7	0.02	0.01	0.01
query8	0.04	0.02	0.02
query9	0.57	0.51	0.52
query10	0.56	0.56	0.57
query11	0.12	0.10	0.10
query12	0.13	0.10	0.10
query13	0.61	0.62	0.61
query14	0.81	0.79	0.80
query15	0.85	0.83	0.81
query16	0.37	0.36	0.40
query17	0.99	0.96	0.97
query18	0.25	0.27	0.25
query19	1.79	1.76	1.69
query20	0.01	0.01	0.01
query21	15.41	0.64	0.61
query22	3.35	3.70	3.43
query23	17.46	1.09	0.99
query24	2.02	0.55	0.56
query25	0.44	0.10	0.10
query26	0.16	0.13	0.13
query27	0.04	0.04	0.05
query28	11.95	0.84	0.84
query29	12.55	3.36	3.20
query30	0.60	0.58	0.53
query31	2.78	0.34	0.35
query32	3.36	0.48	0.49
query33	3.19	3.21	3.21
query34	15.36	4.75	4.72
query35	4.75	4.73	4.74
query36	1.13	1.06	1.07
query37	0.06	0.05	0.05
query38	0.05	0.03	0.02
query39	0.02	0.01	0.02
query40	0.17	0.13	0.14
query41	0.07	0.02	0.01
query42	0.03	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 105.85 s
Total hot run time: 33.4 s

doris-robot avatar Feb 28 '24 11:02 doris-robot

TeamCity be ut coverage result: Function Coverage: 35.64% (8548/23987) Line Coverage: 27.44% (69374/252805) Region Coverage: 26.62% (35976/135155) Branch Coverage: 23.43% (18386/78470) Coverage Report: http://coverage.selectdb-in.cc/coverage/79b90d0e6d1ee594376d460be1d722f84c24b1e8_79b90d0e6d1ee594376d460be1d722f84c24b1e8/report/index.html

doris-robot avatar Feb 28 '24 11:02 doris-robot

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 79b90d0e6d1ee594376d460be1d722f84c24b1e8 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       17.8 seconds inserted 10000000 Rows, about 561K ops/s

doris-robot avatar Feb 28 '24 11:02 doris-robot

run buildall

liaoxin01 avatar Feb 28 '24 13:02 liaoxin01

TPC-H: Total hot run time: 37916 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0a23e751291ddf15970f07c0384db0ab6c5606aa, data reload: false

------ Round 1 ----------------------------------
q1	17691	4063	4064	4063
q2	2049	143	135	135
q3	10649	928	932	928
q4	4674	945	951	945
q5	7606	2909	3024	2909
q6	178	128	123	123
q7	1234	765	770	765
q8	9324	2010	2032	2010
q9	7213	6301	6322	6301
q10	8190	2511	2483	2483
q11	423	203	196	196
q12	786	316	315	315
q13	17965	3194	3210	3194
q14	278	248	280	248
q15	535	499	492	492
q16	468	415	414	414
q17	950	880	874	874
q18	6783	5912	6033	5912
q19	1559	1516	1517	1516
q20	543	274	276	274
q21	6312	3549	3563	3549
q22	800	278	270	270
Total cold run time: 106210 ms
Total hot run time: 37916 ms

----- Round 2, with runtime_filter_mode=off -----
q1	3994	3996	3984	3984
q2	307	214	219	214
q3	3000	2963	2890	2890
q4	1839	1834	1787	1787
q5	5203	5099	5088	5088
q6	197	114	116	114
q7	2147	1754	1783	1754
q8	3127	3195	3205	3195
q9	8263	8251	8312	8251
q10	6070	3634	3667	3634
q11	530	433	424	424
q12	675	530	536	530
q13	13325	3048	3076	3048
q14	271	264	277	264
q15	535	495	496	495
q16	514	481	479	479
q17	1699	1681	1677	1677
q18	7875	7393	7307	7307
q19	1867	1647	1636	1636
q20	2106	1915	1893	1893
q21	4743	4561	4659	4561
q22	535	440	449	440
Total cold run time: 68822 ms
Total hot run time: 53665 ms

doris-robot avatar Feb 28 '24 13:02 doris-robot

TPC-DS: Total hot run time: 168791 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0a23e751291ddf15970f07c0384db0ab6c5606aa, data reload: false

query1	945	351	349	349
query2	6523	1777	1818	1777
query3	6698	205	207	205
query4	23322	20579	20664	20579
query5	4293	362	350	350
query6	268	176	169	169
query7	4603	309	303	303
query8	265	191	197	191
query9	8446	2201	2202	2201
query10	413	224	213	213
query11	14517	14222	14128	14128
query12	146	78	86	78
query13	1638	418	424	418
query14	8659	6281	6338	6281
query15	201	172	174	172
query16	7086	261	249	249
query17	1047	518	495	495
query18	1899	271	270	270
query19	190	151	149	149
query20	88	82	85	82
query21	190	119	124	119
query22	4729	4622	4546	4546
query23	30554	29838	29937	29838
query24	11815	3122	3092	3092
query25	650	349	351	349
query26	1836	148	156	148
query27	3067	334	313	313
query28	7050	1796	1778	1778
query29	1170	546	557	546
query30	285	132	140	132
query31	856	681	704	681
query32	101	58	55	55
query33	718	218	222	218
query34	1046	477	494	477
query35	908	753	759	753
query36	960	881	829	829
query37	162	62	62	62
query38	3107	3002	3027	3002
query39	1314	1253	1240	1240
query40	286	100	101	100
query41	38	36	35	35
query42	101	107	98	98
query43	449	456	469	456
query44	1054	688	693	688
query45	187	181	171	171
query46	1028	780	766	766
query47	1541	1437	1448	1437
query48	420	352	344	344
query49	1142	293	298	293
query50	772	375	372	372
query51	4372	4373	4327	4327
query52	101	86	95	86
query53	339	265	263	263
query54	278	232	233	232
query55	86	84	88	84
query56	210	199	198	198
query57	999	895	893	893
query58	207	188	192	188
query59	2243	2198	1968	1968
query60	234	211	239	211
query61	88	102	82	82
query62	589	369	360	360
query63	279	248	261	248
query64	6592	2987	3113	2987
query65	3262	3211	3203	3203
query66	1448	316	308	308
query67	14567	14093	13687	13687
query68	4033	568	563	563
query69	513	369	387	369
query70	1243	1232	1228	1228
query71	320	246	253	246
query72	6109	2810	2652	2652
query73	717	327	320	320
query74	6227	6014	6020	6014
query75	3094	2437	2422	2422
query76	2340	1049	1157	1049
query77	343	237	229	229
query78	8921	8571	8508	8508
query79	1291	517	514	514
query80	1006	357	359	357
query81	468	195	195	195
query82	947	87	81	81
query83	226	125	117	117
query84	274	79	79	79
query85	1155	355	354	354
query86	362	271	297	271
query87	3265	3139	3084	3084
query88	2723	2363	2341	2341
query89	394	329	323	323
query90	1920	163	163	163
query91	149	123	123	123
query92	59	52	50	50
query93	1224	502	502	502
query94	1266	180	180	180
query95	439	339	343	339
query96	571	267	271	267
query97	4275	4110	4103	4103
query98	226	202	194	194
query99	1055	691	632	632
Total cold run time: 261832 ms
Total hot run time: 168791 ms

doris-robot avatar Feb 28 '24 14:02 doris-robot

ClickBench: Total hot run time: 31.33 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0a23e751291ddf15970f07c0384db0ab6c5606aa, data reload: false

query1	0.04	0.04	0.03
query2	0.06	0.02	0.02
query3	0.23	0.07	0.06
query4	1.66	0.11	0.10
query5	0.53	0.52	0.52
query6	1.30	0.69	0.68
query7	0.02	0.01	0.02
query8	0.03	0.02	0.02
query9	0.56	0.50	0.52
query10	0.56	0.56	0.55
query11	0.13	0.10	0.10
query12	0.12	0.10	0.11
query13	0.63	0.61	0.62
query14	0.77	0.83	0.80
query15	0.85	0.84	0.81
query16	0.38	0.36	0.37
query17	0.99	0.94	1.01
query18	0.27	0.25	0.25
query19	1.78	1.68	1.76
query20	0.01	0.02	0.01
query21	15.40	0.68	0.60
query22	3.62	4.35	2.00
query23	17.45	1.05	0.89
query24	2.16	0.28	0.22
query25	0.42	0.23	0.05
query26	0.15	0.12	0.12
query27	0.05	0.05	0.04
query28	12.35	0.83	0.83
query29	12.52	3.15	3.49
query30	0.59	0.54	0.46
query31	2.78	0.36	0.36
query32	3.35	0.48	0.49
query33	3.23	3.21	3.28
query34	15.36	4.78	4.72
query35	4.76	4.73	4.74
query36	1.14	1.06	1.06
query37	0.07	0.05	0.05
query38	0.05	0.03	0.02
query39	0.02	0.02	0.02
query40	0.17	0.12	0.13
query41	0.07	0.01	0.01
query42	0.03	0.02	0.02
query43	0.03	0.02	0.02
Total cold run time: 106.69 s
Total hot run time: 31.33 s

doris-robot avatar Feb 28 '24 14:02 doris-robot

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 0a23e751291ddf15970f07c0384db0ab6c5606aa with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       18.0 seconds inserted 10000000 Rows, about 555K ops/s

doris-robot avatar Feb 28 '24 14:02 doris-robot

TeamCity be ut coverage result: Function Coverage: 35.63% (8547/23989) Line Coverage: 27.44% (69376/252827) Region Coverage: 26.61% (35975/135169) Branch Coverage: 23.43% (18386/78476) Coverage Report: http://coverage.selectdb-in.cc/coverage/0a23e751291ddf15970f07c0384db0ab6c5606aa_0a23e751291ddf15970f07c0384db0ab6c5606aa/report/index.html

doris-robot avatar Feb 28 '24 14:02 doris-robot

run cloud_p0

liaoxin01 avatar Feb 28 '24 15:02 liaoxin01

run buildall

liaoxin01 avatar Feb 29 '24 03:02 liaoxin01

TPC-H: Total hot run time: 38041 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ced38f8389a29b7ffe8a5684b92d24002d3a26e8, data reload: false

------ Round 1 ----------------------------------
q1	17640	4096	4056	4056
q2	2040	149	129	129
q3	10570	1004	938	938
q4	4664	958	941	941
q5	7607	2894	2996	2894
q6	181	121	121	121
q7	1237	758	755	755
q8	9341	2042	2018	2018
q9	7769	6315	6307	6307
q10	8213	2481	2489	2481
q11	412	202	206	202
q12	716	313	306	306
q13	17930	3225	3199	3199
q14	278	245	247	245
q15	538	499	492	492
q16	477	399	402	399
q17	947	885	873	873
q18	6779	6039	6050	6039
q19	1555	1518	1524	1518
q20	563	281	265	265
q21	6802	3619	3583	3583
q22	809	280	284	280
Total cold run time: 107068 ms
Total hot run time: 38041 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4032	4021	4040	4021
q2	309	215	216	215
q3	2971	2928	2940	2928
q4	1845	1842	1833	1833
q5	5124	5104	5132	5104
q6	199	114	117	114
q7	2122	1722	1781	1722
q8	3133	3188	3214	3188
q9	8244	8268	8233	8233
q10	6106	3672	3658	3658
q11	527	432	430	430
q12	685	514	533	514
q13	7757	3042	3067	3042
q14	279	248	258	248
q15	545	488	499	488
q16	499	474	451	451
q17	1704	1691	1682	1682
q18	7996	7420	7429	7420
q19	1670	1634	1642	1634
q20	2123	1902	1892	1892
q21	4800	4615	4634	4615
q22	500	415	433	415
Total cold run time: 63170 ms
Total hot run time: 53847 ms

doris-robot avatar Feb 29 '24 04:02 doris-robot