doris icon indicating copy to clipboard operation
doris copied to clipboard

[improvement](spill) release memory in time if task is closed

Open jacktengg opened this issue 10 months ago • 24 comments

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

jacktengg avatar Apr 25 '24 16:04 jacktengg

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar Apr 25 '24 16:04 doris-robot

run buildall

jacktengg avatar Apr 25 '24 16:04 jacktengg

run buildall

jacktengg avatar Apr 26 '24 09:04 jacktengg

TeamCity be ut coverage result: Function Coverage: 35.18% (8920/25357) Line Coverage: 26.96% (73352/272087) Region Coverage: 26.14% (37891/144975) Branch Coverage: 22.95% (19290/84040) Coverage Report: http://coverage.selectdb-in.cc/coverage/756e7b9e34a9831d5c872776cd72e18d5d5b894a_756e7b9e34a9831d5c872776cd72e18d5d5b894a/report/index.html

doris-robot avatar Apr 26 '24 09:04 doris-robot

TPC-DS: Total hot run time: 189215 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 756e7b9e34a9831d5c872776cd72e18d5d5b894a, data reload: false

query1	911	369	367	367
query2	6294	2648	2449	2449
query3	6660	204	201	201
query4	24566	21847	22073	21847
query5	4016	413	424	413
query6	249	196	167	167
query7	4616	295	295	295
query8	233	182	195	182
query9	8581	2416	2370	2370
query10	399	250	241	241
query11	15417	14710	14863	14710
query12	120	92	95	92
query13	1748	372	365	365
query14	9799	7728	7632	7632
query15	253	171	163	163
query16	8146	273	268	268
query17	1694	568	552	552
query18	2099	280	268	268
query19	288	152	152	152
query20	97	85	82	82
query21	197	128	129	128
query22	5185	4989	4973	4973
query23	33963	33424	33542	33424
query24	11540	3062	3023	3023
query25	649	395	383	383
query26	1681	156	156	156
query27	2861	316	310	310
query28	7029	1993	1987	1987
query29	1020	618	620	618
query30	234	158	152	152
query31	987	717	722	717
query32	86	50	54	50
query33	737	240	247	240
query34	1040	477	483	477
query35	810	667	670	667
query36	1055	914	893	893
query37	257	63	74	63
query38	3197	3090	3085	3085
query39	1584	1546	1525	1525
query40	249	129	125	125
query41	41	38	38	38
query42	103	95	94	94
query43	565	538	554	538
query44	1160	717	727	717
query45	261	272	279	272
query46	1088	729	728	728
query47	1994	1882	1924	1882
query48	364	294	294	294
query49	991	401	381	381
query50	767	381	374	374
query51	6745	6587	6640	6587
query52	100	89	88	88
query53	359	277	277	277
query54	317	251	227	227
query55	75	72	69	69
query56	257	219	221	219
query57	1230	1163	1147	1147
query58	222	198	197	197
query59	3487	3161	3286	3161
query60	258	230	236	230
query61	105	88	90	88
query62	623	448	447	447
query63	301	284	278	278
query64	9305	7271	7177	7177
query65	3086	3004	3032	3004
query66	1364	334	330	330
query67	15751	15066	15132	15066
query68	9401	542	535	535
query69	578	299	302	299
query70	1387	1106	1065	1065
query71	504	263	269	263
query72	8322	2615	2426	2426
query73	1619	317	318	317
query74	6653	6290	6154	6154
query75	5159	2681	2711	2681
query76	5615	1036	1009	1009
query77	785	262	260	260
query78	11209	10266	10245	10245
query79	11384	513	513	513
query80	1042	431	429	429
query81	510	217	215	215
query82	228	90	92	90
query83	204	161	160	160
query84	259	81	82	81
query85	1125	265	264	264
query86	338	295	298	295
query87	3443	3175	3140	3140
query88	5139	2310	2295	2295
query89	507	372	382	372
query90	2409	182	180	180
query91	124	106	97	97
query92	59	47	46	46
query93	6809	506	498	498
query94	1564	181	179	179
query95	1103	1101	1093	1093
query96	634	267	264	264
query97	3176	2991	2948	2948
query98	229	217	216	216
query99	1076	900	864	864
Total cold run time: 314060 ms
Total hot run time: 189215 ms

doris-robot avatar Apr 26 '24 10:04 doris-robot

run buildall

jacktengg avatar Apr 28 '24 03:04 jacktengg

TPC-H: Total hot run time: 40413 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 566b723d1125074dd39647b94b87320956a0d34f, data reload: false

------ Round 1 ----------------------------------
q1	17599	5149	4265	4265
q2	2011	200	209	200
q3	10729	1187	1240	1187
q4	10506	840	743	743
q5	7577	2736	2736	2736
q6	221	134	135	134
q7	1072	639	615	615
q8	9493	2135	2117	2117
q9	9203	6753	6754	6753
q10	8926	3839	3828	3828
q11	463	234	260	234
q12	575	223	214	214
q13	18506	2972	2927	2927
q14	275	231	227	227
q15	499	473	469	469
q16	521	376	378	376
q17	959	710	653	653
q18	8120	7464	7369	7369
q19	4797	1546	1507	1507
q20	652	304	307	304
q21	5320	3285	3972	3285
q22	336	274	270	270
Total cold run time: 118360 ms
Total hot run time: 40413 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4350	4217	4172	4172
q2	377	271	255	255
q3	3023	2783	2756	2756
q4	1915	1625	1597	1597
q5	5337	5334	5338	5334
q6	211	125	127	125
q7	2267	1847	1844	1844
q8	3216	3343	3355	3343
q9	8570	8568	8577	8568
q10	3936	3703	3693	3693
q11	578	484	491	484
q12	789	589	593	589
q13	17328	2940	2929	2929
q14	309	281	258	258
q15	524	484	478	478
q16	477	411	423	411
q17	1785	1472	1464	1464
q18	7635	7506	7356	7356
q19	1654	1601	1509	1509
q20	1964	1753	1784	1753
q21	4953	4821	4790	4790
q22	561	511	486	486
Total cold run time: 71759 ms
Total hot run time: 54194 ms

doris-robot avatar Apr 28 '24 04:04 doris-robot

TeamCity be ut coverage result: Function Coverage: 35.51% (8925/25136) Line Coverage: 27.12% (73443/270762) Region Coverage: 26.32% (37946/144161) Branch Coverage: 23.11% (19326/83634) Coverage Report: http://coverage.selectdb-in.cc/coverage/566b723d1125074dd39647b94b87320956a0d34f_566b723d1125074dd39647b94b87320956a0d34f/report/index.html

doris-robot avatar Apr 28 '24 04:04 doris-robot

TPC-DS: Total hot run time: 186191 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 566b723d1125074dd39647b94b87320956a0d34f, data reload: false

query1	913	361	339	339
query2	6454	2495	2408	2408
query3	6654	199	201	199
query4	22972	21190	21238	21190
query5	4190	412	412	412
query6	273	189	183	183
query7	4583	292	282	282
query8	250	198	203	198
query9	8420	2327	2299	2299
query10	423	245	235	235
query11	14804	14223	14141	14141
query12	131	87	85	85
query13	1642	360	350	350
query14	10704	8361	7558	7558
query15	269	171	171	171
query16	8200	254	260	254
query17	1914	551	532	532
query18	2103	274	274	274
query19	327	149	155	149
query20	91	88	85	85
query21	195	126	124	124
query22	5030	4811	4884	4811
query23	34000	33265	33339	33265
query24	11833	2963	2864	2864
query25	675	385	386	385
query26	1738	159	148	148
query27	2956	318	321	318
query28	7120	2008	2002	2002
query29	1025	638	626	626
query30	283	154	155	154
query31	998	743	738	738
query32	93	56	53	53
query33	764	253	254	253
query34	1089	476	477	476
query35	826	686	700	686
query36	1111	905	932	905
query37	284	67	69	67
query38	3155	2990	3031	2990
query39	1570	1545	1528	1528
query40	279	126	127	126
query41	46	42	42	42
query42	107	95	99	95
query43	602	566	556	556
query44	1216	730	752	730
query45	280	263	270	263
query46	1083	719	732	719
query47	1954	1850	1893	1850
query48	362	295	301	295
query49	1175	410	419	410
query50	778	385	379	379
query51	6718	6699	6562	6562
query52	96	87	91	87
query53	355	285	288	285
query54	321	240	235	235
query55	77	71	69	69
query56	242	214	219	214
query57	1224	1143	1167	1143
query58	237	202	202	202
query59	3423	3307	3233	3233
query60	249	236	232	232
query61	90	90	102	90
query62	650	434	450	434
query63	307	295	276	276
query64	9448	7160	7173	7160
query65	3111	3082	3058	3058
query66	1408	336	324	324
query67	15781	15314	15036	15036
query68	6705	529	543	529
query69	521	307	304	304
query70	1131	1143	1090	1090
query71	488	264	263	263
query72	7262	2629	2411	2411
query73	731	318	317	317
query74	6610	6083	6136	6083
query75	4063	2648	2678	2648
query76	4897	1043	1022	1022
query77	622	267	260	260
query78	11130	10212	10109	10109
query79	8946	509	519	509
query80	1437	441	425	425
query81	514	219	222	219
query82	1121	97	93	93
query83	199	160	159	159
query84	258	80	82	80
query85	1441	263	254	254
query86	488	286	317	286
query87	3310	3078	3131	3078
query88	5048	2312	2319	2312
query89	562	384	382	382
query90	2003	177	180	177
query91	120	99	96	96
query92	59	46	46	46
query93	7374	524	499	499
query94	1167	180	175	175
query95	383	289	295	289
query96	606	260	256	256
query97	3170	2936	2926	2926
query98	235	226	217	217
query99	1258	883	835	835
Total cold run time: 305540 ms
Total hot run time: 186191 ms

doris-robot avatar Apr 28 '24 04:04 doris-robot

run buildall

jacktengg avatar Apr 29 '24 10:04 jacktengg

run buildall

jacktengg avatar Apr 29 '24 10:04 jacktengg

TPC-H: Total hot run time: 39859 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 40f33bef185be10353451904b7e0a516bfc1acb0, data reload: false

------ Round 1 ----------------------------------
q1	17618	4373	4240	4240
q2	2023	191	209	191
q3	10450	1178	1223	1178
q4	10374	743	761	743
q5	7573	2692	2682	2682
q6	216	134	130	130
q7	1066	631	615	615
q8	9589	2138	2088	2088
q9	9231	6784	6577	6577
q10	8729	3762	3727	3727
q11	466	240	235	235
q12	515	218	221	218
q13	17774	2936	2942	2936
q14	268	235	248	235
q15	512	460	471	460
q16	515	379	386	379
q17	951	667	657	657
q18	8080	7436	7271	7271
q19	5281	1511	1486	1486
q20	653	322	313	313
q21	5026	3287	3220	3220
q22	341	278	285	278
Total cold run time: 117251 ms
Total hot run time: 39859 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4316	4226	4165	4165
q2	381	264	265	264
q3	3012	2742	2696	2696
q4	1863	1563	1575	1563
q5	5284	5295	5317	5295
q6	210	120	122	120
q7	2240	1889	1875	1875
q8	3150	3323	3325	3323
q9	8606	8544	8540	8540
q10	3894	3715	3704	3704
q11	563	474	493	474
q12	738	571	595	571
q13	16408	2944	2949	2944
q14	313	286	271	271
q15	528	460	470	460
q16	497	415	411	411
q17	1764	1475	1452	1452
q18	7697	7477	7390	7390
q19	1663	1503	1543	1503
q20	1956	1749	1780	1749
q21	10620	4644	4678	4644
q22	541	489	498	489
Total cold run time: 76244 ms
Total hot run time: 53903 ms

doris-robot avatar Apr 29 '24 10:04 doris-robot

TeamCity be ut coverage result: Function Coverage: 35.57% (8934/25119) Line Coverage: 27.19% (73667/270908) Region Coverage: 26.39% (38060/144204) Branch Coverage: 23.17% (19395/83720) Coverage Report: http://coverage.selectdb-in.cc/coverage/40f33bef185be10353451904b7e0a516bfc1acb0_40f33bef185be10353451904b7e0a516bfc1acb0/report/index.html

doris-robot avatar Apr 29 '24 11:04 doris-robot

TPC-DS: Total hot run time: 186219 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 40f33bef185be10353451904b7e0a516bfc1acb0, data reload: false

query1	916	358	342	342
query2	6475	2283	2365	2283
query3	6656	212	216	212
query4	23759	21293	21329	21293
query5	4203	434	418	418
query6	268	175	172	172
query7	4584	285	288	285
query8	250	202	192	192
query9	8580	2363	2345	2345
query10	435	241	255	241
query11	14632	14230	14203	14203
query12	138	84	85	84
query13	1632	350	355	350
query14	8697	7586	8326	7586
query15	289	165	182	165
query16	8180	265	259	259
query17	1908	559	533	533
query18	2105	276	294	276
query19	316	148	147	147
query20	90	89	86	86
query21	192	126	131	126
query22	5060	4864	4845	4845
query23	33755	33086	33221	33086
query24	10617	2956	2909	2909
query25	633	390	388	388
query26	1239	156	155	155
query27	2799	320	315	315
query28	7483	2033	2011	2011
query29	868	628	606	606
query30	306	154	158	154
query31	947	748	736	736
query32	96	53	57	53
query33	754	261	256	256
query34	1014	484	489	484
query35	806	682	675	675
query36	1075	896	900	896
query37	143	69	73	69
query38	3159	2992	3014	2992
query39	1598	1541	1537	1537
query40	198	128	129	128
query41	49	42	48	42
query42	108	102	101	101
query43	532	528	524	524
query44	1241	734	757	734
query45	287	237	296	237
query46	1071	729	701	701
query47	1908	1866	1863	1863
query48	374	301	299	299
query49	1039	393	390	390
query50	775	381	387	381
query51	7183	6759	6756	6756
query52	103	96	91	91
query53	345	277	281	277
query54	291	233	245	233
query55	81	75	73	73
query56	238	221	219	219
query57	1201	1151	1123	1123
query58	235	203	199	199
query59	3277	3054	3130	3054
query60	263	236	225	225
query61	91	90	91	90
query62	659	432	451	432
query63	301	279	281	279
query64	8612	7154	7109	7109
query65	3112	3019	3035	3019
query66	872	340	370	340
query67	15204	15027	15012	15012
query68	8522	537	549	537
query69	539	308	312	308
query70	1201	1089	1057	1057
query71	494	269	265	265
query72	8071	2624	2444	2444
query73	730	327	327	327
query74	6452	6264	6024	6024
query75	4241	2703	2677	2677
query76	5123	984	998	984
query77	678	273	268	268
query78	10829	10241	10178	10178
query79	7948	522	515	515
query80	1477	422	433	422
query81	506	219	219	219
query82	823	97	95	95
query83	211	171	166	166
query84	266	82	84	82
query85	1402	264	278	264
query86	413	302	288	288
query87	3332	3124	3124	3124
query88	4895	2341	2334	2334
query89	543	379	374	374
query90	2011	185	187	185
query91	129	98	96	96
query92	58	49	48	48
query93	5881	514	506	506
query94	1122	186	181	181
query95	397	308	303	303
query96	593	261	257	257
query97	3148	2941	2953	2941
query98	235	221	221	221
query99	1251	833	869	833
Total cold run time: 299828 ms
Total hot run time: 186219 ms

doris-robot avatar Apr 29 '24 11:04 doris-robot

run buildall

jacktengg avatar Apr 29 '24 14:04 jacktengg

TPC-H: Total hot run time: 41655 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6a4a6c0e954f351631c68841e356f16aa10686ed, data reload: false

------ Round 1 ----------------------------------
q1	17613	4329	4290	4290
q2	2023	194	202	194
q3	10440	1243	1242	1242
q4	10199	822	765	765
q5	7525	2780	2806	2780
q6	218	130	131	130
q7	1035	630	628	628
q8	9215	2181	2131	2131
q9	9210	6836	6852	6836
q10	9218	3994	3880	3880
q11	458	237	243	237
q12	492	230	219	219
q13	17216	3172	3177	3172
q14	273	248	243	243
q15	518	491	464	464
q16	500	385	386	385
q17	992	738	769	738
q18	8423	7922	7857	7857
q19	5548	1581	1575	1575
q20	640	339	319	319
q21	5284	3291	4155	3291
q22	350	287	279	279
Total cold run time: 117390 ms
Total hot run time: 41655 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4571	4424	4382	4382
q2	391	263	294	263
q3	3204	2965	2972	2965
q4	1894	1594	1577	1577
q5	5497	5524	5528	5524
q6	210	122	124	122
q7	2351	1989	1977	1977
q8	3280	3443	3391	3391
q9	8872	8898	8917	8898
q10	3994	3697	3862	3697
q11	579	512	491	491
q12	785	629	638	629
q13	17286	3148	3103	3103
q14	318	283	271	271
q15	538	474	479	474
q16	488	451	433	433
q17	1788	1486	1474	1474
q18	7740	7520	7384	7384
q19	1650	1471	1528	1471
q20	1966	1751	1783	1751
q21	5939	5018	4808	4808
q22	571	491	474	474
Total cold run time: 73912 ms
Total hot run time: 55559 ms

doris-robot avatar Apr 29 '24 15:04 doris-robot

TeamCity be ut coverage result: Function Coverage: 35.55% (8932/25122) Line Coverage: 27.18% (73644/270929) Region Coverage: 26.38% (38039/144212) Branch Coverage: 23.16% (19390/83726) Coverage Report: http://coverage.selectdb-in.cc/coverage/6a4a6c0e954f351631c68841e356f16aa10686ed_6a4a6c0e954f351631c68841e356f16aa10686ed/report/index.html

doris-robot avatar Apr 29 '24 15:04 doris-robot

TPC-DS: Total hot run time: 186246 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6a4a6c0e954f351631c68841e356f16aa10686ed, data reload: false

query1	916	357	352	352
query2	6458	2267	2454	2267
query3	6638	214	216	214
query4	23428	21236	21376	21236
query5	4220	419	429	419
query6	264	181	169	169
query7	4576	289	286	286
query8	250	196	195	195
query9	8548	2348	2325	2325
query10	447	251	251	251
query11	14891	14087	14292	14087
query12	140	88	87	87
query13	1635	383	376	376
query14	9580	8977	7572	7572
query15	238	175	181	175
query16	7745	274	268	268
query17	1514	580	575	575
query18	1982	289	283	283
query19	211	156	157	156
query20	91	90	90	90
query21	205	126	132	126
query22	5078	4857	4878	4857
query23	33621	33236	33102	33102
query24	5725	2991	2955	2955
query25	532	379	384	379
query26	691	155	146	146
query27	1848	313	331	313
query28	3459	2011	2026	2011
query29	814	622	589	589
query30	232	155	157	155
query31	934	734	724	724
query32	58	51	56	51
query33	484	248	236	236
query34	888	459	463	459
query35	758	704	665	665
query36	1011	910	904	904
query37	106	66	67	66
query38	3147	3021	3008	3008
query39	1568	1551	1544	1544
query40	206	129	127	127
query41	42	39	38	38
query42	107	98	97	97
query43	583	546	535	535
query44	1071	726	748	726
query45	276	263	247	247
query46	1056	734	742	734
query47	1933	1843	1812	1812
query48	372	298	291	291
query49	750	400	407	400
query50	772	396	372	372
query51	6877	6823	6889	6823
query52	106	94	87	87
query53	349	277	277	277
query54	276	238	247	238
query55	78	75	71	71
query56	241	220	217	217
query57	1209	1107	1134	1107
query58	216	202	201	201
query59	3552	3095	3204	3095
query60	268	239	236	236
query61	96	93	91	91
query62	545	449	426	426
query63	302	276	278	276
query64	7500	7183	7171	7171
query65	3101	3054	3018	3018
query66	774	343	346	343
query67	15148	15193	14955	14955
query68	6180	533	545	533
query69	554	312	305	305
query70	1188	1162	1109	1109
query71	469	274	271	271
query72	8135	2664	2409	2409
query73	732	319	327	319
query74	6570	6184	6097	6097
query75	3703	2693	2684	2684
query76	3890	997	1056	997
query77	622	273	266	266
query78	10938	10289	10154	10154
query79	9345	524	506	506
query80	1394	446	439	439
query81	478	230	219	219
query82	839	95	94	94
query83	206	164	163	163
query84	266	83	83	83
query85	925	276	261	261
query86	448	315	296	296
query87	3402	3124	3105	3105
query88	5111	2326	2315	2315
query89	532	378	362	362
query90	2152	208	181	181
query91	123	97	98	97
query92	61	49	46	46
query93	6783	512	493	493
query94	1165	178	184	178
query95	380	296	294	294
query96	606	262	266	262
query97	3156	2966	2925	2925
query98	234	225	217	217
query99	1248	882	886	882
Total cold run time: 284572 ms
Total hot run time: 186246 ms

doris-robot avatar Apr 29 '24 15:04 doris-robot

run buildall

jacktengg avatar Apr 30 '24 10:04 jacktengg

TeamCity be ut coverage result: Function Coverage: 35.58% (8934/25110) Line Coverage: 27.20% (73697/270938) Region Coverage: 26.39% (38057/144235) Branch Coverage: 23.16% (19399/83746) Coverage Report: http://coverage.selectdb-in.cc/coverage/b1ffb911b59cc65779145930a15952ca47f31169_b1ffb911b59cc65779145930a15952ca47f31169/report/index.html

doris-robot avatar Apr 30 '24 11:04 doris-robot

TPC-DS: Total hot run time: 184600 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b1ffb911b59cc65779145930a15952ca47f31169, data reload: false

query1	914	354	346	346
query2	6260	2523	2444	2444
query3	6671	211	212	211
query4	25118	21896	21887	21887
query5	3978	443	407	407
query6	270	168	181	168
query7	4718	310	302	302
query8	250	193	196	193
query9	8734	2478	2461	2461
query10	425	248	256	248
query11	11995	11233	11422	11233
query12	127	94	88	88
query13	1679	382	375	375
query14	8668	8735	7609	7609
query15	241	188	185	185
query16	8209	273	280	273
query17	1860	572	576	572
query18	2099	279	272	272
query19	339	150	154	150
query20	91	83	84	83
query21	193	129	125	125
query22	5057	4882	4869	4869
query23	33971	33192	33306	33192
query24	10642	2897	2860	2860
query25	618	380	380	380
query26	1153	155	154	154
query27	2313	318	335	318
query28	6982	2071	2059	2059
query29	880	670	600	600
query30	220	149	146	146
query31	952	711	731	711
query32	88	49	50	49
query33	741	241	239	239
query34	1059	481	472	472
query35	808	667	685	667
query36	1078	910	944	910
query37	130	61	65	61
query38	3127	2977	2976	2976
query39	1588	1530	1523	1523
query40	207	122	123	122
query41	40	37	36	36
query42	100	96	101	96
query43	584	553	544	544
query44	1200	720	727	720
query45	266	241	250	241
query46	1082	734	710	710
query47	1935	1864	1846	1846
query48	371	297	299	297
query49	848	384	391	384
query50	757	377	382	377
query51	6823	6883	6809	6809
query52	106	90	88	88
query53	344	275	278	275
query54	300	236	226	226
query55	75	72	70	70
query56	234	218	216	216
query57	1206	1142	1105	1105
query58	230	202	193	193
query59	3589	3385	3186	3186
query60	250	240	234	234
query61	87	86	87	86
query62	641	445	436	436
query63	300	275	278	275
query64	8514	7215	7204	7204
query65	3102	3052	3064	3052
query66	865	327	332	327
query67	15684	15047	14980	14980
query68	9555	553	561	553
query69	607	312	306	306
query70	1389	1143	1156	1143
query71	551	261	268	261
query72	8386	2568	2355	2355
query73	1564	326	326	326
query74	6648	6104	6060	6060
query75	5027	2666	2667	2666
query76	5811	1076	1006	1006
query77	805	267	289	267
query78	11233	10185	10222	10185
query79	12490	521	532	521
query80	1697	425	427	425
query81	500	217	220	217
query82	429	95	87	87
query83	200	161	162	161
query84	262	82	83	82
query85	1073	264	260	260
query86	346	311	284	284
query87	3314	3106	3086	3086
query88	5047	2434	2412	2412
query89	522	374	367	367
query90	2137	187	185	185
query91	121	96	97	96
query92	58	47	46	46
query93	7583	515	514	514
query94	1369	179	178	178
query95	400	310	309	309
query96	617	270	260	260
query97	3154	2945	2950	2945
query98	232	220	224	220
query99	1253	864	878	864
Total cold run time: 308366 ms
Total hot run time: 184600 ms

doris-robot avatar Apr 30 '24 11:04 doris-robot

run buildall

jacktengg avatar Apr 30 '24 14:04 jacktengg

TeamCity be ut coverage result: Function Coverage: 35.64% (8952/25116) Line Coverage: 27.24% (73817/270986) Region Coverage: 26.43% (38126/144263) Branch Coverage: 23.19% (19422/83760) Coverage Report: http://coverage.selectdb-in.cc/coverage/f63579e57cdfc12a208ea82ee578e520d2d5aee1_f63579e57cdfc12a208ea82ee578e520d2d5aee1/report/index.html

doris-robot avatar Apr 30 '24 15:04 doris-robot

TPC-DS: Total hot run time: 187601 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f63579e57cdfc12a208ea82ee578e520d2d5aee1, data reload: false

query1	898	369	347	347
query2	6284	2484	2350	2350
query3	6664	212	211	211
query4	23351	21734	21913	21734
query5	3911	415	409	409
query6	269	195	177	177
query7	4535	300	284	284
query8	244	193	188	188
query9	8438	2408	2396	2396
query10	427	250	263	250
query11	15406	14910	14754	14754
query12	118	88	87	87
query13	1641	364	360	360
query14	10732	7420	7605	7420
query15	263	174	170	170
query16	8191	262	277	262
query17	1735	575	554	554
query18	2108	278	273	273
query19	316	156	151	151
query20	90	85	86	85
query21	198	127	124	124
query22	5049	4884	4843	4843
query23	33949	33236	33319	33236
query24	10705	3043	3003	3003
query25	626	394	393	393
query26	1173	151	150	150
query27	2721	307	319	307
query28	7011	2043	2020	2020
query29	859	597	597	597
query30	244	148	147	147
query31	931	736	716	716
query32	95	50	50	50
query33	752	255	237	237
query34	1021	456	472	456
query35	805	681	681	681
query36	1075	885	884	884
query37	134	64	64	64
query38	3160	3035	3002	3002
query39	1580	1546	1529	1529
query40	210	124	127	124
query41	41	35	38	35
query42	104	96	96	96
query43	585	523	545	523
query44	1206	734	724	724
query45	288	277	258	258
query46	1078	714	725	714
query47	1965	1889	1880	1880
query48	363	288	285	285
query49	856	403	390	390
query50	758	391	385	385
query51	6783	6709	6617	6617
query52	99	90	85	85
query53	356	278	284	278
query54	299	233	230	230
query55	82	70	71	70
query56	235	230	221	221
query57	1217	1155	1133	1133
query58	227	195	197	195
query59	3517	3045	3249	3045
query60	251	236	230	230
query61	114	89	87	87
query62	648	464	459	459
query63	306	284	284	284
query64	8673	7305	7274	7274
query65	3092	3067	3075	3067
query66	941	331	331	331
query67	15573	15219	14971	14971
query68	9548	543	531	531
query69	617	307	307	307
query70	1411	1089	1151	1089
query71	547	274	274	274
query72	8482	2628	2490	2490
query73	1585	320	323	320
query74	6604	6114	6097	6097
query75	5232	2707	2673	2673
query76	5902	958	976	958
query77	795	271	281	271
query78	11097	10333	10305	10305
query79	12360	517	517	517
query80	1529	431	429	429
query81	497	219	219	219
query82	270	90	86	86
query83	224	168	174	168
query84	263	84	82	82
query85	1067	264	259	259
query86	356	306	286	286
query87	3308	3062	3101	3062
query88	5221	2318	2313	2313
query89	508	388	381	381
query90	2132	185	182	182
query91	124	98	98	98
query92	61	52	48	48
query93	7194	521	506	506
query94	1363	179	183	179
query95	397	300	305	300
query96	600	262	266	262
query97	3157	2943	2937	2937
query98	228	224	219	219
query99	1224	895	861	861
Total cold run time: 311479 ms
Total hot run time: 187601 ms

doris-robot avatar Apr 30 '24 15:04 doris-robot

run buildall

jacktengg avatar May 05 '24 17:05 jacktengg

TeamCity be ut coverage result: Function Coverage: 35.58% (8965/25197) Line Coverage: 27.22% (73980/271834) Region Coverage: 26.44% (38215/144516) Branch Coverage: 23.21% (19465/83882) Coverage Report: http://coverage.selectdb-in.cc/coverage/96af6bf47079f04cef51736c4deaf7fe052d9111_96af6bf47079f04cef51736c4deaf7fe052d9111/report/index.html

doris-robot avatar May 05 '24 18:05 doris-robot

TPC-DS: Total hot run time: 187897 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 96af6bf47079f04cef51736c4deaf7fe052d9111, data reload: false

query1	930	365	359	359
query2	6442	2328	2349	2328
query3	6661	212	211	211
query4	26694	22069	22013	22013
query5	3732	439	458	439
query6	283	183	172	172
query7	4619	295	291	291
query8	227	196	180	180
query9	8473	2399	2422	2399
query10	415	246	263	246
query11	15367	14796	14845	14796
query12	132	91	87	87
query13	1676	374	370	370
query14	10546	8408	7444	7444
query15	246	167	167	167
query16	8242	269	259	259
query17	1888	591	561	561
query18	2110	283	274	274
query19	331	160	163	160
query20	98	88	86	86
query21	199	125	124	124
query22	5038	4805	4834	4805
query23	34325	33449	33483	33449
query24	10689	2928	2939	2928
query25	620	385	373	373
query26	1368	161	148	148
query27	2868	318	315	315
query28	7460	2040	2019	2019
query29	904	625	615	615
query30	261	156	156	156
query31	949	735	730	730
query32	90	55	54	54
query33	755	299	248	248
query34	971	496	475	475
query35	823	672	666	666
query36	1072	876	934	876
query37	129	66	66	66
query38	3142	2982	2981	2981
query39	1628	1540	1540	1540
query40	201	122	125	122
query41	41	40	36	36
query42	104	103	102	102
query43	578	543	520	520
query44	1181	720	740	720
query45	264	258	230	230
query46	1096	702	734	702
query47	1960	1876	1889	1876
query48	371	296	291	291
query49	838	416	383	383
query50	759	381	383	381
query51	6797	6674	6673	6673
query52	102	87	90	87
query53	347	277	283	277
query54	306	237	248	237
query55	85	75	79	75
query56	249	218	221	218
query57	1221	1134	1103	1103
query58	223	200	201	200
query59	3417	3390	3220	3220
query60	275	249	232	232
query61	92	88	86	86
query62	646	464	450	450
query63	311	281	280	280
query64	8709	7241	7240	7240
query65	3125	3103	3070	3070
query66	1383	366	335	335
query67	15570	15031	14991	14991
query68	9422	543	540	540
query69	547	303	329	303
query70	1411	1138	1079	1079
query71	546	287	280	280
query72	8103	2552	2369	2369
query73	1542	326	324	324
query74	6590	6026	6087	6026
query75	5320	2721	2663	2663
query76	5569	932	1010	932
query77	815	266	267	266
query78	11045	10265	10171	10171
query79	12476	522	510	510
query80	1568	425	419	419
query81	499	221	226	221
query82	734	87	89	87
query83	201	163	163	163
query84	266	86	82	82
query85	1416	316	268	268
query86	408	295	317	295
query87	3437	3135	3078	3078
query88	4752	2307	2310	2307
query89	550	369	366	366
query90	2156	179	175	175
query91	141	95	97	95
query92	58	46	46	46
query93	8098	504	497	497
query94	1525	181	181	181
query95	383	311	298	298
query96	604	258	259	258
query97	3152	2961	2955	2955
query98	231	215	217	215
query99	1263	886	881	881
Total cold run time: 317482 ms
Total hot run time: 187897 ms

doris-robot avatar May 05 '24 18:05 doris-robot