doris icon indicating copy to clipboard operation
doris copied to clipboard

[fix](memory) Fix page cache memory tracker consumption in prune

Open xinyiZzz opened this issue 9 months ago • 5 comments

Proposed changes

when process memory exceed limit, page cache may not prune in time.

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

xinyiZzz avatar Apr 29 '24 14:04 xinyiZzz

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar Apr 29 '24 14:04 doris-robot

run buildall

xinyiZzz avatar Apr 29 '24 14:04 xinyiZzz

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Apr 29 '24 14:04 github-actions[bot]

TeamCity be ut coverage result: Function Coverage: 35.60% (8934/25099) Line Coverage: 27.21% (73652/270644) Region Coverage: 26.40% (38043/144094) Branch Coverage: 23.18% (19390/83646) Coverage Report: http://coverage.selectdb-in.cc/coverage/7726d6b99b95b95cd1fa5ba030c855b5f03e7cb3_7726d6b99b95b95cd1fa5ba030c855b5f03e7cb3/report/index.html

doris-robot avatar Apr 29 '24 15:04 doris-robot

TPC-DS: Total hot run time: 185889 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7726d6b99b95b95cd1fa5ba030c855b5f03e7cb3, data reload: false

query1	916	362	347	347
query2	6472	2404	2360	2360
query3	6649	219	223	219
query4	25164	21151	21406	21151
query5	4180	424	418	418
query6	262	178	186	178
query7	4585	287	283	283
query8	252	192	191	191
query9	8476	2330	2325	2325
query10	444	248	250	248
query11	14840	14181	14270	14181
query12	153	91	86	86
query13	1631	350	354	350
query14	9761	7433	7767	7433
query15	237	179	171	171
query16	8129	261	256	256
query17	1856	557	546	546
query18	2096	274	268	268
query19	209	150	142	142
query20	89	84	82	82
query21	193	123	132	123
query22	5045	4828	4778	4778
query23	33825	33068	33143	33068
query24	11108	2956	2884	2884
query25	624	374	366	366
query26	1475	149	146	146
query27	3063	314	326	314
query28	7644	1969	1986	1969
query29	918	595	594	594
query30	293	150	151	150
query31	999	741	720	720
query32	92	53	56	53
query33	757	256	253	253
query34	1031	481	502	481
query35	820	697	684	684
query36	1072	903	910	903
query37	136	66	67	66
query38	3159	3021	2978	2978
query39	1605	1546	1532	1532
query40	274	125	126	125
query41	40	40	38	38
query42	102	95	102	95
query43	562	548	528	528
query44	1194	730	742	730
query45	273	258	260	258
query46	1074	735	723	723
query47	1907	1864	1838	1838
query48	356	299	290	290
query49	1154	408	402	402
query50	770	394	395	394
query51	6796	6740	6767	6740
query52	102	91	91	91
query53	360	276	280	276
query54	288	234	242	234
query55	77	72	73	72
query56	241	217	216	216
query57	1201	1137	1134	1134
query58	234	226	196	196
query59	3537	3380	3128	3128
query60	254	232	242	232
query61	92	86	90	86
query62	665	469	455	455
query63	304	276	274	274
query64	9326	7112	7146	7112
query65	3167	3060	3042	3042
query66	1404	341	346	341
query67	15372	14862	14959	14862
query68	5241	543	538	538
query69	488	302	306	302
query70	1100	1097	1112	1097
query71	408	276	273	273
query72	8274	2779	2563	2563
query73	695	328	327	327
query74	6479	6011	6037	6011
query75	3379	2699	2676	2676
query76	3085	1029	987	987
query77	411	272	274	272
query78	11350	10278	10335	10278
query79	8642	524	528	524
query80	1935	459	444	444
query81	529	224	223	223
query82	1442	94	93	93
query83	305	172	173	172
query84	271	85	87	85
query85	2106	266	261	261
query86	513	306	308	306
query87	3283	3092	3056	3056
query88	4986	2300	2301	2300
query89	556	361	363	361
query90	2016	180	180	180
query91	126	98	95	95
query92	59	46	47	46
query93	6335	508	501	501
query94	1231	187	181	181
query95	383	298	295	295
query96	609	266	260	260
query97	3133	2922	2953	2922
query98	235	209	217	209
query99	1244	842	885	842
Total cold run time: 302235 ms
Total hot run time: 185889 ms

doris-robot avatar Apr 29 '24 15:04 doris-robot

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar May 06 '24 04:05 github-actions[bot]

PR approved by anyone and no changes requested.

github-actions[bot] avatar May 06 '24 04:05 github-actions[bot]