doris icon indicating copy to clipboard operation
doris copied to clipboard

[chore](memory) ScopedAllocatorTagger

Open zhiqiang-hhhh opened this issue 1 year ago • 9 comments

zhiqiang-hhhh avatar Jul 01 '24 06:07 zhiqiang-hhhh

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar Jul 01 '24 06:07 doris-robot

run buildall

zhiqiang-hhhh avatar Jul 01 '24 07:07 zhiqiang-hhhh

run buildall

zhiqiang-hhhh avatar Jul 01 '24 07:07 zhiqiang-hhhh

run buildall

zhiqiang-hhhh avatar Jul 01 '24 08:07 zhiqiang-hhhh

run buildall

zhiqiang-hhhh avatar Jul 01 '24 08:07 zhiqiang-hhhh

TPC-H: Total hot run time: 40044 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cb9b7e242323dd19b048dc9676b37b9375733046, data reload: false

------ Round 1 ----------------------------------
q1	17606	4463	4321	4321
q2	2022	195	194	194
q3	10479	1207	1154	1154
q4	10194	903	754	754
q5	7492	2699	2698	2698
q6	219	139	140	139
q7	947	599	612	599
q8	9240	2110	2103	2103
q9	9199	6545	6528	6528
q10	9033	3775	3713	3713
q11	469	240	237	237
q12	430	232	235	232
q13	17890	3003	2951	2951
q14	269	224	226	224
q15	508	490	474	474
q16	508	374	367	367
q17	990	601	731	601
q18	8137	7590	7490	7490
q19	7807	1404	1414	1404
q20	665	327	330	327
q21	4915	3200	3906	3200
q22	390	336	334	334
Total cold run time: 119409 ms
Total hot run time: 40044 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4427	4336	4197	4197
q2	372	262	264	262
q3	3102	2877	2923	2877
q4	1975	1726	1709	1709
q5	5789	5535	5463	5463
q6	240	135	131	131
q7	2328	1814	1839	1814
q8	3282	3785	3411	3411
q9	8739	8763	8768	8763
q10	4177	3709	3837	3709
q11	582	502	496	496
q12	804	643	603	603
q13	17340	3153	3223	3153
q14	305	263	289	263
q15	528	470	489	470
q16	488	452	439	439
q17	1870	1524	1488	1488
q18	8133	7952	7814	7814
q19	1786	1653	1587	1587
q20	2912	1886	1836	1836
q21	5555	4933	4815	4815
q22	645	533	554	533
Total cold run time: 75379 ms
Total hot run time: 55833 ms

doris-robot avatar Jul 01 '24 09:07 doris-robot

run buildall

zhiqiang-hhhh avatar Jul 01 '24 09:07 zhiqiang-hhhh

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Jul 01 '24 09:07 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Jul 01 '24 09:07 github-actions[bot]

run buildall

zhiqiang-hhhh avatar Jul 04 '24 08:07 zhiqiang-hhhh

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Jul 04 '24 08:07 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Jul 04 '24 08:07 github-actions[bot]

run buildall

zhiqiang-hhhh avatar Jul 05 '24 06:07 zhiqiang-hhhh

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Jul 05 '24 06:07 github-actions[bot]

run buildall

zhiqiang-hhhh avatar Jul 05 '24 06:07 zhiqiang-hhhh

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Jul 05 '24 06:07 github-actions[bot]

run p0

zhiqiang-hhhh avatar Jul 07 '24 09:07 zhiqiang-hhhh

run p0

zhiqiang-hhhh avatar Jul 08 '24 02:07 zhiqiang-hhhh

run performance

zhiqiang-hhhh avatar Jul 09 '24 12:07 zhiqiang-hhhh

run buildall

zhiqiang-hhhh avatar Jul 11 '24 16:07 zhiqiang-hhhh

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Jul 11 '24 17:07 github-actions[bot]

run buildall

zhiqiang-hhhh avatar Jul 17 '24 09:07 zhiqiang-hhhh

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Jul 17 '24 09:07 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Jul 17 '24 09:07 github-actions[bot]

TPC-H: Total hot run time: 40095 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 753432beffb3b25b57eece842ce4177152449535, data reload: false

------ Round 1 ----------------------------------
q1	18168	4595	4387	4387
q2	2721	193	195	193
q3	11351	1213	1160	1160
q4	10371	860	810	810
q5	7599	2762	2734	2734
q6	224	138	137	137
q7	979	613	611	611
q8	9238	2101	2079	2079
q9	8753	6601	6516	6516
q10	8793	3797	3791	3791
q11	467	242	243	242
q12	395	228	218	218
q13	17770	3029	2981	2981
q14	277	241	228	228
q15	534	504	494	494
q16	489	380	380	380
q17	978	609	621	609
q18	8212	7676	7386	7386
q19	6523	1361	1348	1348
q20	710	332	331	331
q21	4927	3173	3306	3173
q22	354	293	287	287
Total cold run time: 119833 ms
Total hot run time: 40095 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4380	4240	4209	4209
q2	372	272	267	267
q3	3014	2724	2796	2724
q4	1895	1642	1607	1607
q5	5316	5343	5358	5343
q6	219	133	131	131
q7	2114	1703	1674	1674
q8	3189	3360	3355	3355
q9	8450	8399	8468	8399
q10	3888	3749	3665	3665
q11	581	483	495	483
q12	783	602	606	602
q13	16436	2962	2944	2944
q14	310	283	269	269
q15	511	472	471	471
q16	490	418	428	418
q17	1784	1480	1477	1477
q18	7663	7514	7462	7462
q19	1666	1600	1530	1530
q20	2004	1808	1762	1762
q21	4811	4802	4755	4755
q22	614	506	519	506
Total cold run time: 70490 ms
Total hot run time: 54053 ms

doris-robot avatar Jul 17 '24 10:07 doris-robot

TPC-DS: Total hot run time: 173217 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 753432beffb3b25b57eece842ce4177152449535, data reload: false

query1	907	370	371	370
query2	6470	1928	1826	1826
query3	6679	208	219	208
query4	28375	17458	17388	17388
query5	4181	485	469	469
query6	263	176	157	157
query7	4583	285	290	285
query8	237	196	203	196
query9	8624	2386	2383	2383
query10	450	277	274	274
query11	10835	10229	10043	10043
query12	137	85	81	81
query13	1643	374	385	374
query14	10268	7756	7722	7722
query15	246	179	173	173
query16	7667	331	326	326
query17	1786	557	538	538
query18	1719	288	280	280
query19	196	157	155	155
query20	91	92	84	84
query21	206	133	132	132
query22	4451	4066	4009	4009
query23	34092	33116	33292	33116
query24	11125	2841	2847	2841
query25	644	389	386	386
query26	1338	158	149	149
query27	2830	274	272	272
query28	7397	2005	1987	1987
query29	915	645	630	630
query30	290	150	152	150
query31	968	737	788	737
query32	104	53	59	53
query33	791	312	303	303
query34	933	491	491	491
query35	692	677	604	604
query36	1093	937	993	937
query37	143	79	79	79
query38	2903	2764	2731	2731
query39	879	817	812	812
query40	276	122	119	119
query41	52	44	43	43
query42	111	98	102	98
query43	506	470	473	470
query44	1177	752	733	733
query45	192	160	160	160
query46	1089	750	737	737
query47	1862	1772	1748	1748
query48	366	295	297	295
query49	1097	411	397	397
query50	778	391	392	391
query51	6962	6805	6699	6699
query52	101	89	90	89
query53	356	292	290	290
query54	916	447	445	445
query55	75	72	71	71
query56	302	255	283	255
query57	1161	1073	1025	1025
query58	247	237	243	237
query59	2956	2783	2656	2656
query60	297	272	269	269
query61	95	94	93	93
query62	841	646	660	646
query63	321	290	286	286
query64	9678	2194	1666	1666
query65	3150	3090	3131	3090
query66	906	352	349	349
query67	15553	14982	15008	14982
query68	8417	552	543	543
query69	691	450	344	344
query70	1107	1107	1143	1107
query71	499	277	270	270
query72	7959	5487	5821	5487
query73	1285	324	322	322
query74	6293	5657	5698	5657
query75	4008	2670	2698	2670
query76	4827	955	1042	955
query77	663	313	317	313
query78	9662	9217	9787	9217
query79	7691	519	520	519
query80	2229	469	461	461
query81	593	224	227	224
query82	748	133	135	133
query83	272	169	166	166
query84	273	87	86	86
query85	1391	299	282	282
query86	382	329	323	323
query87	3300	3082	3110	3082
query88	4744	2464	2502	2464
query89	516	389	379	379
query90	1875	188	187	187
query91	124	101	98	98
query92	58	48	48	48
query93	5403	513	509	509
query94	1052	213	214	213
query95	413	324	324	324
query96	612	272	269	269
query97	3191	3073	3019	3019
query98	218	205	197	197
query99	1733	1259	1262	1259
Total cold run time: 300803 ms
Total hot run time: 173217 ms

doris-robot avatar Jul 17 '24 11:07 doris-robot

ClickBench: Total hot run time: 30.56 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 753432beffb3b25b57eece842ce4177152449535, data reload: false

query1	0.04	0.04	0.02
query2	0.08	0.03	0.04
query3	0.22	0.05	0.05
query4	1.68	0.09	0.10
query5	0.50	0.49	0.48
query6	1.14	0.72	0.72
query7	0.02	0.01	0.02
query8	0.06	0.05	0.05
query9	0.55	0.48	0.49
query10	0.54	0.55	0.53
query11	0.15	0.11	0.11
query12	0.14	0.12	0.12
query13	0.59	0.59	0.58
query14	0.78	0.79	0.78
query15	0.86	0.82	0.83
query16	0.38	0.38	0.36
query17	0.96	1.00	1.00
query18	0.23	0.22	0.22
query19	1.84	1.70	1.69
query20	0.02	0.01	0.01
query21	15.40	0.75	0.67
query22	4.26	6.79	2.01
query23	18.31	1.33	1.17
query24	2.07	0.22	0.24
query25	0.14	0.10	0.08
query26	0.29	0.20	0.21
query27	0.45	0.23	0.22
query28	13.31	1.00	1.00
query29	12.63	3.33	3.30
query30	0.25	0.05	0.06
query31	2.88	0.39	0.38
query32	3.29	0.49	0.47
query33	2.90	2.88	2.98
query34	17.15	4.30	4.31
query35	4.46	4.44	4.40
query36	0.65	0.46	0.46
query37	0.19	0.16	0.17
query38	0.15	0.15	0.16
query39	0.04	0.04	0.03
query40	0.15	0.12	0.12
query41	0.09	0.04	0.05
query42	0.06	0.05	0.05
query43	0.05	0.05	0.05
Total cold run time: 109.95 s
Total hot run time: 30.56 s

doris-robot avatar Jul 17 '24 11:07 doris-robot

run buildall

zhiqiang-hhhh avatar Jul 18 '24 02:07 zhiqiang-hhhh

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Jul 18 '24 02:07 github-actions[bot]

run buildall

zhiqiang-hhhh avatar Jul 18 '24 03:07 zhiqiang-hhhh