doris icon indicating copy to clipboard operation
doris copied to clipboard

[fix](bdbje) Initializing and starting the first fe node will cause an exception when the disk is insufficient.

Open liugddx opened this issue 1 year ago • 6 comments

Proposed changes

Issue Number: close #xxx

38bffceac452bed9207665df2941c0d

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

liugddx avatar Feb 21 '24 11:02 liugddx

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

doris-robot avatar Feb 21 '24 11:02 doris-robot

run buildall

liugddx avatar Feb 21 '24 11:02 liugddx

TPC-H: Total hot run time: 41841 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fcf2b4979e060afee957a1de90432086f2a6bde4, data reload: false

------ Round 1 ----------------------------------
q1	17618	5011	4921	4921
q2	2048	152	136	136
q3	10762	1045	1050	1045
q4	5922	993	1002	993
q5	8780	3309	3380	3309
q6	206	138	135	135
q7	1302	804	801	801
q8	9599	2156	2161	2156
q9	8051	6772	6725	6725
q10	8299	2645	2636	2636
q11	422	210	217	210
q12	766	353	341	341
q13	17992	3681	3688	3681
q14	293	255	255	255
q15	627	507	486	486
q16	483	404	404	404
q17	940	886	889	886
q18	7332	6775	6565	6565
q19	1575	1507	1496	1496
q20	551	357	338	338
q21	6301	4039	3974	3974
q22	795	357	348	348
Total cold run time: 110664 ms
Total hot run time: 41841 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4862	4897	4872	4872
q2	297	195	190	190
q3	3612	3609	3609	3609
q4	2523	2547	2506	2506
q5	5761	5736	5750	5736
q6	213	128	130	128
q7	2254	1667	1650	1650
q8	3059	3103	3161	3103
q9	8738	8788	8756	8756
q10	6158	4245	4255	4245
q11	536	396	386	386
q12	780	542	546	542
q13	4160	3389	3370	3370
q14	270	244	245	244
q15	625	513	503	503
q16	493	454	440	440
q17	1724	1643	1676	1643
q18	8340	7625	7722	7625
q19	1654	1670	1663	1663
q20	2130	1835	1841	1835
q21	6631	6244	6191	6191
q22	584	531	530	530
Total cold run time: 65404 ms
Total hot run time: 59767 ms

doris-robot avatar Feb 21 '24 11:02 doris-robot

TPC-DS: Total hot run time: 176229 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit fcf2b4979e060afee957a1de90432086f2a6bde4, data reload: false

query1	921	351	341	341
query2	6507	1663	1750	1663
query3	6695	203	211	203
query4	23072	21072	21156	21072
query5	4292	376	367	367
query6	254	166	165	165
query7	4616	286	296	286
query8	249	198	199	198
query9	8450	2795	2768	2768
query10	425	228	223	223
query11	14922	14569	14400	14400
query12	136	85	83	83
query13	1696	417	424	417
query14	9043	7555	7471	7471
query15	215	182	190	182
query16	7281	270	256	256
query17	1389	570	536	536
query18	1987	268	260	260
query19	185	144	147	144
query20	84	81	81	81
query21	184	116	118	116
query22	5153	4680	4893	4680
query23	32630	31509	31493	31493
query24	12775	3509	3405	3405
query25	637	374	364	364
query26	1885	154	158	154
query27	3052	318	301	301
query28	6618	1855	1834	1834
query29	1240	606	612	606
query30	285	140	147	140
query31	924	749	747	747
query32	99	58	54	54
query33	736	239	252	239
query34	1067	488	495	488
query35	941	808	828	808
query36	1004	894	888	888
query37	178	59	61	59
query38	3299	3169	3175	3169
query39	1361	1351	1319	1319
query40	282	110	105	105
query41	38	37	35	35
query42	101	95	98	95
query43	481	452	445	445
query44	1079	695	712	695
query45	197	177	178	177
query46	1032	757	762	757
query47	1628	1559	1554	1554
query48	405	342	347	342
query49	1230	298	294	294
query50	772	366	372	366
query51	4478	4267	4315	4267
query52	104	93	88	88
query53	389	299	303	299
query54	282	218	215	215
query55	79	74	79	74
query56	221	205	192	192
query57	1047	952	945	945
query58	219	201	197	197
query59	2283	2178	2131	2131
query60	231	226	221	221
query61	85	90	79	79
query62	597	397	373	373
query63	325	285	274	274
query64	6456	3059	3115	3059
query65	3279	3266	3260	3260
query66	1364	327	322	322
query67	14576	14452	14133	14133
query68	4627	555	563	555
query69	490	362	360	360
query70	1214	1184	1246	1184
query71	344	260	250	250
query72	6285	2796	2607	2607
query73	701	317	310	310
query74	6867	6484	6443	6443
query75	3149	2542	2553	2542
query76	3082	1152	1213	1152
query77	338	234	231	231
query78	9344	8890	8866	8866
query79	974	502	500	500
query80	622	347	337	337
query81	440	203	203	203
query82	244	82	85	82
query83	243	126	124	124
query84	224	76	79	76
query85	1140	346	345	345
query86	308	314	295	295
query87	3452	3338	3322	3322
query88	2716	2307	2298	2298
query89	430	358	351	351
query90	2035	167	165	165
query91	155	124	131	124
query92	51	48	47	47
query93	1024	519	499	499
query94	1136	173	182	173
query95	487	378	376	376
query96	581	267	260	260
query97	4459	4358	4248	4248
query98	237	206	200	200
query99	1083	781	730	730
Total cold run time: 268229 ms
Total hot run time: 176229 ms

doris-robot avatar Feb 21 '24 11:02 doris-robot

ClickBench: Total hot run time: 31.02 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit fcf2b4979e060afee957a1de90432086f2a6bde4, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.03	0.03
query3	0.23	0.08	0.08
query4	1.64	0.10	0.10
query5	0.48	0.48	0.48
query6	1.33	0.61	0.62
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.54	0.46	0.44
query10	0.48	0.48	0.48
query11	0.12	0.09	0.09
query12	0.12	0.10	0.09
query13	0.59	0.59	0.58
query14	0.76	0.77	0.77
query15	0.82	0.81	0.80
query16	0.32	0.32	0.33
query17	0.90	0.89	0.89
query18	0.16	0.18	0.16
query19	1.70	1.60	1.66
query20	0.01	0.01	0.01
query21	15.41	0.62	0.61
query22	3.22	3.32	2.55
query23	18.03	0.97	0.99
query24	2.10	0.35	0.57
query25	0.65	0.06	0.07
query26	0.16	0.13	0.13
query27	0.06	0.05	0.05
query28	11.94	0.84	0.79
query29	12.77	3.49	3.32
query30	0.53	0.49	0.46
query31	2.77	0.36	0.36
query32	3.35	0.47	0.47
query33	3.12	3.14	3.12
query34	15.35	4.52	4.49
query35	4.45	4.48	4.48
query36	1.07	0.93	0.94
query37	0.07	0.05	0.05
query38	0.03	0.04	0.03
query39	0.02	0.01	0.02
query40	0.17	0.15	0.15
query41	0.06	0.01	0.02
query42	0.02	0.02	0.02
query43	0.02	0.02	0.01
Total cold run time: 105.73 s
Total hot run time: 31.02 s

doris-robot avatar Feb 21 '24 11:02 doris-robot

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit fcf2b4979e060afee957a1de90432086f2a6bde4 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.5 seconds inserted 10000000 Rows, about 740K ops/s

doris-robot avatar Feb 21 '24 11:02 doris-robot

We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable. If you'd like to revive this PR, please reopen it and feel free a maintainer to remove the Stale tag!

github-actions[bot] avatar Aug 21 '24 00:08 github-actions[bot]