doris icon indicating copy to clipboard operation
doris copied to clipboard

[test](case) Remove sensitive information in k8s deploy test

Open yongjinhou opened this issue 9 months ago • 13 comments

Proposed changes

Issue Number: close #xxx

Remove sensitive information from the k8s deployment test, otherwise the code base security check fails.

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

yongjinhou avatar May 22 '24 03:05 yongjinhou

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar May 22 '24 03:05 doris-robot

run buildall

yongjinhou avatar May 22 '24 03:05 yongjinhou

TPC-DS: Total hot run time: 180687 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 784ad2b8bdb6d24c4deea614adfe31d3a7fc376c, data reload: false

query1	928	384	370	370
query2	6472	2470	2316	2316
query3	6644	205	212	205
query4	27123	21219	21214	21214
query5	4159	406	415	406
query6	263	171	172	171
query7	4590	283	279	279
query8	240	191	199	191
query9	8554	2395	2392	2392
query10	441	244	256	244
query11	14802	14165	14181	14165
query12	149	86	88	86
query13	1640	377	361	361
query14	10195	6901	7811	6901
query15	217	175	174	174
query16	7816	250	256	250
query17	1811	557	543	543
query18	1951	273	264	264
query19	210	147	145	145
query20	90	83	83	83
query21	199	128	134	128
query22	5048	4858	4816	4816
query23	34053	33821	33562	33562
query24	11289	2973	2854	2854
query25	620	362	362	362
query26	1231	152	148	148
query27	3072	313	313	313
query28	7734	2042	2057	2042
query29	881	595	590	590
query30	320	169	199	169
query31	981	750	759	750
query32	84	54	52	52
query33	737	242	230	230
query34	1045	475	468	468
query35	821	677	650	650
query36	1101	919	921	919
query37	146	69	82	69
query38	2893	2798	2742	2742
query39	1643	1584	1563	1563
query40	203	129	122	122
query41	55	46	47	46
query42	102	95	100	95
query43	578	601	553	553
query44	1176	716	733	716
query45	264	251	252	251
query46	1084	719	709	709
query47	1937	1864	1903	1864
query48	359	286	291	286
query49	1088	403	438	403
query50	771	380	375	375
query51	6848	6844	6729	6729
query52	108	87	96	87
query53	354	288	276	276
query54	838	443	435	435
query55	70	69	74	69
query56	237	218	228	218
query57	1230	1150	1175	1150
query58	227	208	196	196
query59	3596	3256	3452	3256
query60	245	230	233	230
query61	89	91	87	87
query62	679	470	467	467
query63	336	282	283	282
query64	9277	2230	1696	1696
query65	3193	3118	3106	3106
query66	1406	352	385	352
query67	15556	15112	14929	14929
query68	4563	527	523	523
query69	480	308	297	297
query70	1162	1156	1142	1142
query71	421	265	267	265
query72	7795	2588	2354	2354
query73	707	317	316	316
query74	6597	6200	6215	6200
query75	3320	2624	2596	2596
query76	2402	1043	1001	1001
query77	409	259	260	259
query78	10595	10093	10028	10028
query79	2261	513	506	506
query80	968	428	432	428
query81	523	239	246	239
query82	633	143	91	91
query83	240	163	167	163
query84	234	85	86	85
query85	1781	266	261	261
query86	521	320	306	306
query87	3284	3113	3138	3113
query88	4266	2320	2321	2320
query89	477	381	388	381
query90	1988	184	184	184
query91	123	96	101	96
query92	56	50	52	50
query93	2246	503	488	488
query94	1181	176	178	176
query95	388	308	294	294
query96	590	265	258	258
query97	3197	3008	2985	2985
query98	235	219	219	219
query99	1146	891	903	891
Total cold run time: 288888 ms
Total hot run time: 180687 ms

doris-robot avatar May 22 '24 04:05 doris-robot

ClickBench: Total hot run time: 30.2 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 784ad2b8bdb6d24c4deea614adfe31d3a7fc376c, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.04
query3	0.23	0.04	0.04
query4	1.68	0.06	0.07
query5	0.51	0.51	0.49
query6	1.13	0.73	0.72
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.54	0.48	0.49
query10	0.54	0.54	0.53
query11	0.16	0.12	0.11
query12	0.14	0.12	0.12
query13	0.59	0.58	0.59
query14	0.78	0.76	0.76
query15	0.81	0.79	0.81
query16	0.35	0.35	0.35
query17	0.99	1.02	0.95
query18	0.22	0.24	0.26
query19	1.80	1.74	1.77
query20	0.01	0.00	0.01
query21	15.63	0.68	0.65
query22	4.60	7.28	1.76
query23	18.35	1.31	1.26
query24	1.41	0.32	0.25
query25	0.16	0.07	0.08
query26	0.25	0.18	0.16
query27	0.07	0.08	0.08
query28	13.34	1.01	1.00
query29	13.22	3.30	3.28
query30	0.25	0.05	0.06
query31	2.90	0.38	0.38
query32	3.28	0.46	0.47
query33	2.88	2.88	2.90
query34	17.18	4.38	4.42
query35	4.53	4.45	4.54
query36	0.65	0.45	0.46
query37	0.17	0.15	0.15
query38	0.16	0.14	0.15
query39	0.04	0.03	0.04
query40	0.17	0.13	0.14
query41	0.09	0.05	0.04
query42	0.04	0.04	0.05
query43	0.04	0.03	0.04
Total cold run time: 110.07 s
Total hot run time: 30.2 s

doris-robot avatar May 22 '24 04:05 doris-robot

run p0

yongjinhou avatar May 22 '24 06:05 yongjinhou

run p0

yongjinhou avatar May 22 '24 06:05 yongjinhou

run p0

yongjinhou avatar May 22 '24 08:05 yongjinhou

run buildall

yongjinhou avatar May 22 '24 08:05 yongjinhou

TPC-H: Total hot run time: 39871 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6241642b3d142051cd7abbc18a9f6705a3206dcb, data reload: false

------ Round 1 ----------------------------------
q1	17947	4486	4240	4240
q2	2026	191	187	187
q3	10461	1264	1158	1158
q4	10148	859	857	857
q5	7462	2645	2668	2645
q6	215	130	134	130
q7	950	585	588	585
q8	9231	2053	2078	2053
q9	8868	6466	6445	6445
q10	8970	3758	3661	3661
q11	434	247	240	240
q12	409	228	223	223
q13	17768	3037	2994	2994
q14	262	226	219	219
q15	527	470	465	465
q16	490	387	381	381
q17	947	654	659	654
q18	8111	7587	7411	7411
q19	6348	1528	1518	1518
q20	662	307	331	307
q21	4897	3215	3885	3215
q22	349	283	284	283
Total cold run time: 117482 ms
Total hot run time: 39871 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4396	4283	4261	4261
q2	356	272	274	272
q3	2960	2729	2735	2729
q4	1834	1632	1557	1557
q5	5241	5277	5282	5277
q6	213	126	126	126
q7	2083	1702	1764	1702
q8	3171	3344	3332	3332
q9	8269	8338	8321	8321
q10	3870	3689	3694	3689
q11	577	478	488	478
q12	782	572	593	572
q13	16452	3011	3022	3011
q14	289	262	264	262
q15	507	464	477	464
q16	456	436	414	414
q17	1799	1481	1514	1481
q18	7562	7564	7448	7448
q19	1976	1535	1556	1535
q20	1975	1808	1797	1797
q21	4809	4686	4786	4686
q22	589	490	485	485
Total cold run time: 70166 ms
Total hot run time: 53899 ms

doris-robot avatar May 22 '24 09:05 doris-robot

TPC-DS: Total hot run time: 170763 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6241642b3d142051cd7abbc18a9f6705a3206dcb, data reload: false

query1	913	375	363	363
query2	7023	2395	2398	2395
query3	6651	212	204	204
query4	20857	17564	17269	17269
query5	4149	436	419	419
query6	249	153	153	153
query7	4588	301	288	288
query8	242	204	193	193
query9	8716	2393	2381	2381
query10	459	290	276	276
query11	10671	9918	10041	9918
query12	139	87	88	87
query13	1638	356	352	352
query14	10138	6915	6093	6093
query15	205	171	178	171
query16	7890	258	254	254
query17	1862	517	508	508
query18	1976	264	264	264
query19	223	153	157	153
query20	101	85	85	85
query21	191	130	133	130
query22	4370	3946	3954	3946
query23	33667	33032	33060	33032
query24	12114	2867	2832	2832
query25	673	354	375	354
query26	1800	175	159	159
query27	3004	325	317	317
query28	7632	2071	2046	2046
query29	1106	604	588	588
query30	308	170	175	170
query31	960	761	721	721
query32	90	54	55	54
query33	771	270	265	265
query34	1050	481	485	481
query35	730	593	609	593
query36	1081	923	942	923
query37	294	73	76	73
query38	2902	2805	2764	2764
query39	870	800	785	785
query40	270	135	133	133
query41	53	46	46	46
query42	106	101	100	100
query43	590	560	575	560
query44	1275	731	756	731
query45	188	166	161	161
query46	1085	729	728	728
query47	1896	1744	1754	1744
query48	364	294	285	285
query49	1240	376	385	376
query50	767	402	400	400
query51	6885	6832	6862	6832
query52	98	90	89	89
query53	363	287	283	283
query54	987	431	418	418
query55	74	75	72	72
query56	267	244	247	244
query57	1138	1040	1022	1022
query58	242	211	222	211
query59	3543	3271	3174	3174
query60	307	270	251	251
query61	89	87	88	87
query62	645	461	456	456
query63	319	291	289	289
query64	9802	2200	1744	1744
query65	3167	3100	3097	3097
query66	1390	351	325	325
query67	15227	14931	14743	14743
query68	4479	532	535	532
query69	440	261	261	261
query70	1204	1145	1090	1090
query71	423	271	274	271
query72	7293	5838	4824	4824
query73	700	318	318	318
query74	6003	5613	5640	5613
query75	3500	2681	2608	2608
query76	2864	1077	1042	1042
query77	459	273	267	267
query78	10212	10105	9656	9656
query79	1976	536	527	527
query80	1612	466	458	458
query81	526	249	246	246
query82	644	101	165	101
query83	265	175	181	175
query84	246	85	83	83
query85	1780	270	266	266
query86	528	310	316	310
query87	3366	3074	3100	3074
query88	4154	2324	2314	2314
query89	480	388	384	384
query90	2002	191	195	191
query91	124	97	97	97
query92	64	56	52	52
query93	2222	513	505	505
query94	1248	190	184	184
query95	405	306	320	306
query96	570	262	262	262
query97	3194	3017	3044	3017
query98	244	222	219	219
query99	1247	850	853	850
Total cold run time: 279154 ms
Total hot run time: 170763 ms

doris-robot avatar May 22 '24 09:05 doris-robot

ClickBench: Total hot run time: 30.29 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6241642b3d142051cd7abbc18a9f6705a3206dcb, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.66	0.09	0.08
query5	0.50	0.50	0.51
query6	1.13	0.73	0.73
query7	0.02	0.01	0.01
query8	0.05	0.04	0.05
query9	0.54	0.50	0.49
query10	0.55	0.55	0.53
query11	0.15	0.12	0.11
query12	0.15	0.12	0.12
query13	0.60	0.60	0.59
query14	0.78	0.77	0.77
query15	0.82	0.82	0.81
query16	0.37	0.37	0.36
query17	0.96	0.97	0.97
query18	0.20	0.27	0.22
query19	1.74	1.67	1.67
query20	0.02	0.01	0.01
query21	15.45	0.72	0.66
query22	3.95	7.67	1.87
query23	18.33	1.42	1.18
query24	1.87	0.26	0.21
query25	0.16	0.08	0.08
query26	0.26	0.17	0.16
query27	0.07	0.08	0.08
query28	13.33	1.02	0.99
query29	12.88	3.34	3.28
query30	0.25	0.06	0.05
query31	2.86	0.39	0.37
query32	3.29	0.47	0.48
query33	2.87	2.93	2.88
query34	17.08	4.41	4.39
query35	4.52	4.45	4.51
query36	0.66	0.46	0.47
query37	0.17	0.16	0.14
query38	0.15	0.15	0.14
query39	0.05	0.04	0.03
query40	0.17	0.14	0.15
query41	0.09	0.04	0.05
query42	0.05	0.05	0.05
query43	0.04	0.04	0.05
Total cold run time: 109.14 s
Total hot run time: 30.29 s

doris-robot avatar May 22 '24 09:05 doris-robot

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar May 22 '24 11:05 github-actions[bot]

PR approved by anyone and no changes requested.

github-actions[bot] avatar May 22 '24 11:05 github-actions[bot]