doris icon indicating copy to clipboard operation
doris copied to clipboard

[Improvement]Add more load cpu usage to workload group

Open wangbo opened this issue 1 year ago • 13 comments

Proposed changes

Add more workload cpu usage to workload group. 1 AsyncResultWriter's cpu usage. 2 Memtable flush's cpu usage when memtable is not on sink side.

wangbo avatar Oct 17 '24 12:10 wangbo

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar Oct 17 '24 12:10 doris-robot

run buildall

wangbo avatar Oct 17 '24 12:10 wangbo

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Oct 17 '24 12:10 github-actions[bot]

TeamCity be ut coverage result: Function Coverage: 37.46% (9709/25920) Line Coverage: 28.72% (80586/280624) Region Coverage: 28.17% (41712/148096) Branch Coverage: 24.74% (21206/85708) Coverage Report: http://coverage.selectdb-in.cc/coverage/7483a4aea057482b0b80d41ff440da0ee1bfc1a0_7483a4aea057482b0b80d41ff440da0ee1bfc1a0/report/index.html

doris-robot avatar Oct 17 '24 13:10 doris-robot

TPC-H: Total hot run time: 41734 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7483a4aea057482b0b80d41ff440da0ee1bfc1a0, data reload: false

------ Round 1 ----------------------------------
q1	17582	7519	7356	7356
q2	2031	299	293	293
q3	11926	1087	1213	1087
q4	10582	840	794	794
q5	7775	3142	3128	3128
q6	243	153	149	149
q7	1058	637	609	609
q8	9363	1930	1944	1930
q9	6668	6502	6454	6454
q10	7045	2433	2479	2433
q11	452	241	240	240
q12	424	228	220	220
q13	17770	2992	3032	2992
q14	251	209	219	209
q15	574	526	523	523
q16	631	591	588	588
q17	998	523	573	523
q18	7422	6747	6761	6747
q19	1379	953	1033	953
q20	497	186	181	181
q21	4166	3358	3304	3304
q22	1095	1027	1021	1021
Total cold run time: 109932 ms
Total hot run time: 41734 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7341	7349	7297	7297
q2	338	247	244	244
q3	3084	2977	2997	2977
q4	2105	1837	1857	1837
q5	5799	5804	5854	5804
q6	236	152	148	148
q7	2290	1818	1852	1818
q8	3436	3463	3509	3463
q9	8950	8968	8962	8962
q10	3608	3604	3597	3597
q11	609	484	504	484
q12	889	612	600	600
q13	10648	3150	3139	3139
q14	320	279	275	275
q15	569	528	528	528
q16	698	647	653	647
q17	1860	1652	1640	1640
q18	8406	7911	7707	7707
q19	1729	1452	1546	1452
q20	2115	1863	1847	1847
q21	5549	5444	5360	5360
q22	1150	1090	1042	1042
Total cold run time: 71729 ms
Total hot run time: 60868 ms

doris-robot avatar Oct 17 '24 13:10 doris-robot

TPC-DS: Total hot run time: 192208 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7483a4aea057482b0b80d41ff440da0ee1bfc1a0, data reload: false

query1	869	391	416	391
query2	6249	2087	2010	2010
query3	8680	194	195	194
query4	34021	23677	23634	23634
query5	3734	488	460	460
query6	291	162	165	162
query7	4191	313	294	294
query8	280	222	257	222
query9	9323	2730	2729	2729
query10	445	290	277	277
query11	17895	15339	15113	15113
query12	156	104	104	104
query13	1569	429	412	412
query14	9812	7748	7658	7658
query15	256	171	189	171
query16	7719	455	483	455
query17	1620	592	581	581
query18	1579	319	312	312
query19	377	168	165	165
query20	125	114	114	114
query21	211	106	108	106
query22	4689	4548	4716	4548
query23	34915	34160	33847	33847
query24	10955	2773	2827	2773
query25	618	416	396	396
query26	1258	158	161	158
query27	2450	279	289	279
query28	7636	2459	2432	2432
query29	840	425	421	421
query30	248	151	151	151
query31	1063	788	809	788
query32	101	57	58	57
query33	770	300	305	300
query34	929	519	526	519
query35	884	746	767	746
query36	1140	964	932	932
query37	161	94	90	90
query38	4033	3893	4022	3893
query39	1466	1453	1421	1421
query40	252	101	98	98
query41	48	47	46	46
query42	126	103	103	103
query43	529	488	489	488
query44	1293	808	808	808
query45	205	165	171	165
query46	1141	711	709	709
query47	1910	1824	1835	1824
query48	451	316	324	316
query49	912	437	439	437
query50	800	398	398	398
query51	7224	6947	6988	6947
query52	99	89	91	89
query53	274	188	183	183
query54	1204	424	452	424
query55	81	80	80	80
query56	287	270	300	270
query57	1283	1170	1163	1163
query58	228	238	229	229
query59	3261	3091	2916	2916
query60	289	277	270	270
query61	105	104	103	103
query62	860	671	663	663
query63	216	184	180	180
query64	5017	632	620	620
query65	3313	3178	3218	3178
query66	1307	304	309	304
query67	15881	15531	15632	15531
query68	4648	585	570	570
query69	494	288	295	288
query70	1123	1106	1113	1106
query71	358	273	271	271
query72	7303	3958	3987	3958
query73	772	355	373	355
query74	10474	9113	9123	9113
query75	3455	2651	2671	2651
query76	3128	910	968	910
query77	568	296	296	296
query78	10604	9601	9677	9601
query79	1189	598	607	598
query80	2088	453	468	453
query81	564	242	240	240
query82	755	142	132	132
query83	285	137	133	133
query84	280	72	71	71
query85	1558	306	283	283
query86	389	304	276	276
query87	4523	4319	4325	4319
query88	3368	2229	2198	2198
query89	408	293	285	285
query90	2333	188	187	187
query91	138	100	104	100
query92	66	48	49	48
query93	1096	532	530	530
query94	1233	289	285	285
query95	365	250	248	248
query96	613	281	281	281
query97	3291	3096	3154	3096
query98	207	203	194	194
query99	1694	1304	1275	1275
Total cold run time: 301524 ms
Total hot run time: 192208 ms

doris-robot avatar Oct 17 '24 14:10 doris-robot

ClickBench: Total hot run time: 32.88 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7483a4aea057482b0b80d41ff440da0ee1bfc1a0, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.03	0.03
query3	0.22	0.06	0.06
query4	1.64	0.10	0.10
query5	0.50	0.49	0.50
query6	1.13	0.74	0.72
query7	0.02	0.01	0.02
query8	0.04	0.03	0.04
query9	0.57	0.50	0.49
query10	0.54	0.55	0.55
query11	0.14	0.11	0.11
query12	0.15	0.11	0.11
query13	0.60	0.59	0.59
query14	2.74	2.75	2.84
query15	0.90	0.82	0.85
query16	0.40	0.38	0.37
query17	1.03	1.01	1.03
query18	0.20	0.19	0.20
query19	1.83	1.89	2.05
query20	0.02	0.01	0.01
query21	15.39	0.57	0.58
query22	2.89	2.49	2.13
query23	16.76	1.12	0.79
query24	3.32	1.26	0.95
query25	0.21	0.04	0.21
query26	0.56	0.14	0.13
query27	0.04	0.05	0.04
query28	10.48	1.10	1.08
query29	12.54	3.18	3.16
query30	0.25	0.06	0.06
query31	2.86	0.39	0.39
query32	3.24	0.46	0.45
query33	3.02	3.02	3.04
query34	16.89	4.46	4.50
query35	4.54	4.49	4.49
query36	0.66	0.47	0.48
query37	0.08	0.06	0.05
query38	0.05	0.03	0.04
query39	0.03	0.02	0.02
query40	0.16	0.13	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.88 s
Total hot run time: 32.88 s

doris-robot avatar Oct 17 '24 14:10 doris-robot

run buildall

wangbo avatar Oct 18 '24 09:10 wangbo

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Oct 18 '24 09:10 github-actions[bot]

TPC-H: Total hot run time: 41687 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit af66d2dc2ed3c9caf3f924eb53d51c91544d7bd3, data reload: false

------ Round 1 ----------------------------------
q1	17582	7469	7323	7323
q2	2030	297	275	275
q3	12301	1075	1151	1075
q4	10573	852	893	852
q5	7760	3143	3104	3104
q6	239	154	148	148
q7	1031	607	615	607
q8	9360	1996	1967	1967
q9	6674	6523	6459	6459
q10	7033	2444	2496	2444
q11	447	239	255	239
q12	414	222	217	217
q13	17768	3014	3018	3014
q14	253	220	222	220
q15	582	518	524	518
q16	640	588	586	586
q17	983	538	474	474
q18	7332	6771	6813	6771
q19	1371	1003	1032	1003
q20	480	182	186	182
q21	4033	3215	3206	3206
q22	1138	1014	1003	1003
Total cold run time: 110024 ms
Total hot run time: 41687 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7256	7227	7252	7227
q2	340	238	237	237
q3	3115	2988	3052	2988
q4	2105	1791	1781	1781
q5	5804	5806	5853	5806
q6	238	154	151	151
q7	2286	1805	1876	1805
q8	3398	3527	3536	3527
q9	8980	9003	9045	9003
q10	3626	3588	3573	3573
q11	594	487	486	486
q12	834	621	666	621
q13	7069	3176	3183	3176
q14	305	278	293	278
q15	574	508	522	508
q16	690	668	615	615
q17	1856	1644	1620	1620
q18	8406	7914	7681	7681
q19	1739	1572	1466	1466
q20	2115	1877	1879	1877
q21	5712	5434	5458	5434
q22	1142	1103	1032	1032
Total cold run time: 68184 ms
Total hot run time: 60892 ms

doris-robot avatar Oct 18 '24 10:10 doris-robot

TeamCity be ut coverage result: Function Coverage: 37.47% (9712/25918) Line Coverage: 28.74% (80651/280601) Region Coverage: 28.17% (41722/148091) Branch Coverage: 24.75% (21212/85702) Coverage Report: http://coverage.selectdb-in.cc/coverage/af66d2dc2ed3c9caf3f924eb53d51c91544d7bd3_af66d2dc2ed3c9caf3f924eb53d51c91544d7bd3/report/index.html

doris-robot avatar Oct 18 '24 10:10 doris-robot

TPC-DS: Total hot run time: 193344 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit af66d2dc2ed3c9caf3f924eb53d51c91544d7bd3, data reload: false

query1	883	403	416	403
query2	6275	2174	2139	2139
query3	8686	194	202	194
query4	34192	23759	23745	23745
query5	3655	487	472	472
query6	283	166	165	165
query7	4187	295	292	292
query8	294	254	229	229
query9	9574	2736	2721	2721
query10	477	270	271	270
query11	18108	15324	15399	15324
query12	158	102	100	100
query13	1559	426	425	425
query14	9952	7700	7673	7673
query15	281	172	178	172
query16	7456	520	522	520
query17	1742	596	592	592
query18	2019	335	335	335
query19	397	169	160	160
query20	124	117	115	115
query21	213	108	121	108
query22	4836	4463	4472	4463
query23	35040	34366	34334	34334
query24	11008	2739	2771	2739
query25	634	413	418	413
query26	1043	159	163	159
query27	2203	284	283	283
query28	7366	2442	2454	2442
query29	778	434	429	429
query30	288	155	152	152
query31	1048	818	814	814
query32	104	59	59	59
query33	765	293	300	293
query34	1015	509	515	509
query35	906	745	757	745
query36	1127	952	962	952
query37	157	85	90	85
query38	4079	3884	3873	3873
query39	1504	1432	1420	1420
query40	214	101	101	101
query41	50	49	51	49
query42	126	103	104	103
query43	539	495	492	492
query44	1249	814	821	814
query45	198	165	167	165
query46	1143	711	718	711
query47	1943	1805	1823	1805
query48	427	325	325	325
query49	928	444	435	435
query50	845	386	404	386
query51	7195	6965	6838	6838
query52	103	95	91	91
query53	258	185	187	185
query54	1238	431	444	431
query55	77	86	76	76
query56	306	274	285	274
query57	1336	1161	1229	1161
query58	246	253	238	238
query59	3229	3093	3031	3031
query60	307	269	273	269
query61	104	108	104	104
query62	857	684	671	671
query63	220	189	182	182
query64	3888	641	628	628
query65	3292	3200	3225	3200
query66	848	312	306	306
query67	15902	15647	15693	15647
query68	4374	565	557	557
query69	511	286	306	286
query70	1169	1143	1149	1143
query71	360	285	283	283
query72	7457	3980	3999	3980
query73	773	363	359	359
query74	10320	9055	9031	9031
query75	3473	2658	2704	2658
query76	2992	918	876	876
query77	620	300	309	300
query78	10465	9616	9617	9616
query79	1431	603	598	598
query80	2257	434	467	434
query81	571	239	239	239
query82	739	147	145	145
query83	290	135	133	133
query84	280	71	69	69
query85	1353	308	292	292
query86	372	300	282	282
query87	4542	4255	4272	4255
query88	3231	2248	2169	2169
query89	400	295	285	285
query90	2189	191	188	188
query91	139	99	100	99
query92	68	49	48	48
query93	1093	531	535	531
query94	1065	307	302	302
query95	358	246	254	246
query96	621	278	285	278
query97	3324	3162	3134	3134
query98	209	207	190	190
query99	1574	1302	1302	1302
Total cold run time: 300104 ms
Total hot run time: 193344 ms

doris-robot avatar Oct 18 '24 11:10 doris-robot

ClickBench: Total hot run time: 33.08 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit af66d2dc2ed3c9caf3f924eb53d51c91544d7bd3, data reload: false

query1	0.03	0.03	0.02
query2	0.06	0.03	0.03
query3	0.23	0.07	0.06
query4	1.65	0.10	0.10
query5	0.53	0.49	0.52
query6	1.13	0.73	0.73
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.57	0.49	0.52
query10	0.55	0.56	0.55
query11	0.14	0.11	0.11
query12	0.14	0.10	0.11
query13	0.62	0.59	0.60
query14	2.81	2.76	2.71
query15	0.92	0.83	0.82
query16	0.38	0.39	0.38
query17	1.09	1.01	1.06
query18	0.20	0.20	0.20
query19	1.98	1.87	2.01
query20	0.01	0.01	0.01
query21	15.35	0.60	0.58
query22	2.42	1.83	1.98
query23	16.94	0.99	0.78
query24	3.35	1.51	1.43
query25	0.31	0.12	0.07
query26	0.50	0.14	0.15
query27	0.03	0.04	0.04
query28	9.81	1.10	1.08
query29	12.53	3.29	3.22
query30	0.26	0.05	0.05
query31	2.87	0.38	0.38
query32	3.26	0.47	0.46
query33	2.99	3.03	3.05
query34	17.29	4.48	4.46
query35	4.48	4.44	4.49
query36	0.67	0.49	0.49
query37	0.08	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.02	0.03
query40	0.16	0.13	0.12
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.02	0.02
Total cold run time: 106.63 s
Total hot run time: 33.08 s

doris-robot avatar Oct 18 '24 11:10 doris-robot

run buildall

wangbo avatar Oct 21 '24 09:10 wangbo

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Oct 21 '24 09:10 github-actions[bot]

TeamCity be ut coverage result: Function Coverage: 37.47% (9701/25893) Line Coverage: 28.70% (80507/280483) Region Coverage: 28.15% (41656/148002) Branch Coverage: 24.72% (21171/85650) Coverage Report: http://coverage.selectdb-in.cc/coverage/e866888fcca6f5a9ef0371ef54b04b3cc2dd70ca_e866888fcca6f5a9ef0371ef54b04b3cc2dd70ca/report/index.html

doris-robot avatar Oct 21 '24 11:10 doris-robot

TPC-H: Total hot run time: 41595 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e866888fcca6f5a9ef0371ef54b04b3cc2dd70ca, data reload: false

------ Round 1 ----------------------------------
q1	17576	7452	7305	7305
q2	2029	284	275	275
q3	11569	1101	1141	1101
q4	10598	898	822	822
q5	7778	3119	3114	3114
q6	249	154	150	150
q7	1015	628	611	611
q8	9354	2011	1958	1958
q9	6626	6495	6512	6495
q10	7087	2442	2443	2442
q11	447	244	252	244
q12	424	233	224	224
q13	17792	2993	3042	2993
q14	251	215	218	215
q15	571	515	511	511
q16	645	595	583	583
q17	991	601	554	554
q18	7386	6688	6816	6688
q19	1353	903	906	903
q20	508	184	188	184
q21	4126	3236	3230	3230
q22	1120	997	993	993
Total cold run time: 109495 ms
Total hot run time: 41595 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7303	7284	7265	7265
q2	324	230	224	224
q3	3026	2933	2940	2933
q4	2095	1797	1837	1797
q5	5815	5771	5859	5771
q6	233	147	145	145
q7	2328	1827	1812	1812
q8	3447	3520	3476	3476
q9	8999	8986	8938	8938
q10	3601	3574	3585	3574
q11	593	492	482	482
q12	852	625	611	611
q13	10639	3236	3242	3236
q14	301	279	279	279
q15	574	535	531	531
q16	681	630	645	630
q17	1873	1618	1606	1606
q18	8270	7881	7459	7459
q19	1738	1443	1580	1443
q20	2170	1894	1908	1894
q21	5498	5320	5463	5320
q22	1155	1073	1020	1020
Total cold run time: 71515 ms
Total hot run time: 60446 ms

doris-robot avatar Oct 21 '24 11:10 doris-robot

TPC-DS: Total hot run time: 193461 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e866888fcca6f5a9ef0371ef54b04b3cc2dd70ca, data reload: false

query1	937	402	410	402
query2	6265	2082	2063	2063
query3	8676	195	198	195
query4	34356	23783	23767	23767
query5	3556	473	481	473
query6	264	166	165	165
query7	4195	299	297	297
query8	284	228	225	225
query9	9549	2753	2748	2748
query10	468	293	272	272
query11	17855	15301	15183	15183
query12	156	100	105	100
query13	1548	426	417	417
query14	9355	7611	7436	7436
query15	268	180	187	180
query16	8056	509	491	491
query17	1680	611	578	578
query18	2207	310	317	310
query19	378	164	171	164
query20	125	113	117	113
query21	213	110	118	110
query22	4853	4488	4441	4441
query23	35436	34344	35211	34344
query24	11086	2753	2822	2753
query25	593	429	403	403
query26	952	160	171	160
query27	2407	290	300	290
query28	7650	2459	2462	2459
query29	697	432	427	427
query30	280	164	153	153
query31	1063	801	843	801
query32	100	54	55	54
query33	783	303	309	303
query34	913	514	536	514
query35	892	761	766	761
query36	1114	944	943	943
query37	159	90	92	90
query38	4105	3919	3977	3919
query39	1518	1437	1449	1437
query40	205	101	100	100
query41	48	49	47	47
query42	131	105	101	101
query43	548	504	492	492
query44	1245	811	818	811
query45	197	166	171	166
query46	1140	728	714	714
query47	1929	1833	1867	1833
query48	413	331	337	331
query49	983	439	465	439
query50	826	398	399	398
query51	7204	6907	7017	6907
query52	102	92	90	90
query53	263	187	185	185
query54	1237	465	446	446
query55	82	81	78	78
query56	316	268	288	268
query57	1294	1199	1165	1165
query58	227	240	240	240
query59	3178	3070	3136	3070
query60	303	271	277	271
query61	114	101	101	101
query62	847	665	686	665
query63	224	191	187	187
query64	3934	639	623	623
query65	3299	3205	3206	3205
query66	852	297	308	297
query67	16013	15819	15633	15633
query68	4432	569	568	568
query69	530	290	293	290
query70	1209	1144	1140	1140
query71	409	279	303	279
query72	7488	3988	3944	3944
query73	781	352	360	352
query74	10588	9175	9129	9129
query75	3734	2653	2723	2653
query76	3472	941	916	916
query77	633	316	294	294
query78	10587	9684	9619	9619
query79	1914	606	616	606
query80	1094	450	477	450
query81	598	243	242	242
query82	725	144	142	142
query83	299	133	134	133
query84	277	69	71	69
query85	1396	301	285	285
query86	377	286	309	286
query87	4452	4461	4500	4461
query88	3429	2224	2188	2188
query89	415	295	290	290
query90	2004	190	188	188
query91	139	101	100	100
query92	65	49	49	49
query93	1795	547	550	547
query94	1067	288	292	288
query95	352	259	243	243
query96	613	279	289	279
query97	3331	3145	3198	3145
query98	219	191	195	191
query99	1589	1325	1291	1291
Total cold run time: 302159 ms
Total hot run time: 193461 ms

doris-robot avatar Oct 21 '24 11:10 doris-robot

ClickBench: Total hot run time: 33.4 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e866888fcca6f5a9ef0371ef54b04b3cc2dd70ca, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.02	0.03
query3	0.23	0.06	0.06
query4	1.64	0.10	0.09
query5	0.50	0.51	0.50
query6	1.14	0.73	0.72
query7	0.02	0.01	0.02
query8	0.03	0.03	0.04
query9	0.56	0.52	0.51
query10	0.55	0.54	0.54
query11	0.14	0.10	0.10
query12	0.13	0.11	0.11
query13	0.60	0.59	0.59
query14	2.80	2.74	2.81
query15	0.89	0.84	0.82
query16	0.38	0.37	0.38
query17	1.04	1.03	1.04
query18	0.20	0.19	0.20
query19	1.89	1.92	2.04
query20	0.01	0.01	0.01
query21	15.36	0.59	0.57
query22	2.44	2.44	2.66
query23	16.99	0.88	0.77
query24	2.99	1.07	1.66
query25	0.31	0.27	0.11
query26	0.38	0.13	0.14
query27	0.04	0.04	0.04
query28	10.28	1.09	1.06
query29	12.64	3.21	3.21
query30	0.25	0.05	0.06
query31	2.89	0.39	0.38
query32	3.28	0.46	0.45
query33	3.02	2.99	3.02
query34	16.89	4.46	4.47
query35	4.48	4.50	4.56
query36	0.68	0.48	0.48
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.12	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.25 s
Total hot run time: 33.4 s

doris-robot avatar Oct 21 '24 11:10 doris-robot

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Oct 22 '24 05:10 github-actions[bot]

run buildall

wangbo avatar Oct 22 '24 06:10 wangbo

TPC-H: Total hot run time: 41385 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 63256814e8d38ae26341ca43918edb8b1d205cf7, data reload: false

------ Round 1 ----------------------------------
q1	17613	7518	7357	7357
q2	2034	277	278	277
q3	12172	1089	1235	1089
q4	10574	907	754	754
q5	7758	3112	3109	3109
q6	240	149	147	147
q7	1043	611	596	596
q8	9359	1936	1994	1936
q9	6683	6517	6449	6449
q10	7095	2407	2404	2404
q11	450	234	238	234
q12	412	219	210	210
q13	17776	2979	2982	2979
q14	256	214	217	214
q15	572	511	512	511
q16	629	577	582	577
q17	985	592	585	585
q18	7373	6693	6779	6693
q19	1361	957	1068	957
q20	489	191	185	185
q21	4056	3321	3144	3144
q22	1131	1007	978	978
Total cold run time: 110061 ms
Total hot run time: 41385 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7582	7344	7262	7262
q2	347	253	250	250
q3	3081	2951	2972	2951
q4	2114	1817	1815	1815
q5	5711	5784	5820	5784
q6	235	150	146	146
q7	2255	1842	1784	1784
q8	3415	3452	3535	3452
q9	8918	8958	8937	8937
q10	3581	3568	3572	3568
q11	591	482	475	475
q12	858	648	643	643
q13	11510	3199	3229	3199
q14	298	297	275	275
q15	576	535	516	516
q16	684	626	660	626
q17	1883	1636	1616	1616
q18	8354	7870	7753	7753
q19	1702	1465	1562	1465
q20	2140	1880	1871	1871
q21	5522	5304	5379	5304
q22	1138	1073	1044	1044
Total cold run time: 72495 ms
Total hot run time: 60736 ms

doris-robot avatar Oct 22 '24 07:10 doris-robot

TPC-DS: Total hot run time: 192486 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 63256814e8d38ae26341ca43918edb8b1d205cf7, data reload: false

query1	939	394	411	394
query2	6272	2104	2059	2059
query3	8679	196	205	196
query4	34195	23748	23666	23666
query5	3456	491	478	478
query6	265	164	162	162
query7	4196	308	288	288
query8	285	232	233	232
query9	9353	2725	2734	2725
query10	465	269	275	269
query11	17766	15327	15299	15299
query12	157	106	100	100
query13	1568	435	409	409
query14	9757	7623	7453	7453
query15	251	169	179	169
query16	7792	472	460	460
query17	1612	596	588	588
query18	1539	302	320	302
query19	397	157	161	157
query20	131	116	114	114
query21	215	105	108	105
query22	4991	4721	4460	4460
query23	34768	34537	34301	34301
query24	10962	2796	2814	2796
query25	627	412	419	412
query26	1107	166	160	160
query27	2560	280	282	280
query28	7643	2432	2421	2421
query29	796	430	412	412
query30	261	151	148	148
query31	1033	792	809	792
query32	104	53	56	53
query33	773	296	291	291
query34	934	504	518	504
query35	912	781	772	772
query36	1095	934	979	934
query37	145	98	89	89
query38	4042	3953	3961	3953
query39	1476	1422	1426	1422
query40	199	97	98	97
query41	49	47	47	47
query42	120	102	100	100
query43	526	475	472	472
query44	1238	814	812	812
query45	198	165	170	165
query46	1135	694	722	694
query47	1987	1825	1834	1825
query48	424	327	329	327
query49	964	424	434	424
query50	830	382	395	382
query51	7168	6975	6893	6893
query52	101	89	90	89
query53	263	178	178	178
query54	1287	424	431	424
query55	83	78	77	77
query56	282	255	287	255
query57	1325	1156	1181	1156
query58	233	256	246	246
query59	3159	3003	3151	3003
query60	304	263	277	263
query61	104	100	95	95
query62	866	673	671	671
query63	215	187	184	184
query64	4034	614	599	599
query65	3291	3200	3203	3200
query66	1285	302	341	302
query67	16021	15659	15763	15659
query68	4762	555	542	542
query69	474	279	315	279
query70	1204	1040	1127	1040
query71	382	287	283	283
query72	7089	3939	3954	3939
query73	789	355	352	352
query74	10257	9072	8921	8921
query75	3451	2662	2659	2659
query76	2779	856	932	856
query77	589	291	297	291
query78	10565	9676	9626	9626
query79	1571	602	592	592
query80	2345	440	450	440
query81	594	237	237	237
query82	710	139	132	132
query83	321	136	134	134
query84	282	70	71	70
query85	1700	297	294	294
query86	446	305	282	282
query87	4512	4323	4341	4323
query88	2898	2232	2155	2155
query89	399	289	296	289
query90	2113	190	185	185
query91	131	98	99	98
query92	67	47	48	47
query93	1526	540	548	540
query94	1237	281	278	278
query95	360	256	251	251
query96	624	284	297	284
query97	3307	3162	3107	3107
query98	216	196	194	194
query99	1679	1302	1324	1302
Total cold run time: 300589 ms
Total hot run time: 192486 ms

doris-robot avatar Oct 22 '24 07:10 doris-robot

ClickBench: Total hot run time: 32.42 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 63256814e8d38ae26341ca43918edb8b1d205cf7, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.04	0.03
query3	0.22	0.06	0.06
query4	1.65	0.10	0.10
query5	0.51	0.49	0.51
query6	1.14	0.73	0.73
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.56	0.50	0.50
query10	0.55	0.54	0.54
query11	0.14	0.10	0.11
query12	0.13	0.12	0.11
query13	0.61	0.61	0.59
query14	2.79	2.72	2.81
query15	0.91	0.82	0.84
query16	0.39	0.39	0.38
query17	1.08	0.98	1.03
query18	0.21	0.20	0.20
query19	1.89	1.80	2.04
query20	0.01	0.01	0.01
query21	15.36	0.58	0.56
query22	2.40	2.10	1.69
query23	16.95	1.17	0.86
query24	3.22	2.18	1.00
query25	0.38	0.14	0.05
query26	0.56	0.14	0.14
query27	0.04	0.04	0.04
query28	9.78	1.08	1.08
query29	12.54	3.20	3.18
query30	0.24	0.06	0.06
query31	2.88	0.38	0.36
query32	3.28	0.47	0.46
query33	3.05	2.98	3.04
query34	17.12	4.53	4.44
query35	4.49	4.48	4.52
query36	0.68	0.49	0.49
query37	0.08	0.06	0.06
query38	0.04	0.03	0.03
query39	0.04	0.03	0.03
query40	0.16	0.13	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.39 s
Total hot run time: 32.42 s

doris-robot avatar Oct 22 '24 07:10 doris-robot

TeamCity be ut coverage result: Function Coverage: 37.45% (9702/25908) Line Coverage: 28.69% (80490/280536) Region Coverage: 28.14% (41648/148024) Branch Coverage: 24.71% (21164/85656) Coverage Report: http://coverage.selectdb-in.cc/coverage/63256814e8d38ae26341ca43918edb8b1d205cf7_63256814e8d38ae26341ca43918edb8b1d205cf7/report/index.html

doris-robot avatar Oct 22 '24 07:10 doris-robot

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar Oct 23 '24 02:10 github-actions[bot]

PR approved by anyone and no changes requested.

github-actions[bot] avatar Oct 23 '24 02:10 github-actions[bot]