doris icon indicating copy to clipboard operation
doris copied to clipboard

[feature](merge-cloud) Add cloud cluster auth and cloud route

Open deardeng opened this issue 1 year ago • 12 comments

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

deardeng avatar Feb 04 '24 02:02 deardeng

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

doris-robot avatar Feb 04 '24 02:02 doris-robot

run buildall

dataroaring avatar Feb 05 '24 04:02 dataroaring

run buildall

deardeng avatar Feb 06 '24 09:02 deardeng

run buildall

deardeng avatar Feb 06 '24 09:02 deardeng

run buildall

deardeng avatar Feb 06 '24 11:02 deardeng

PR approved by anyone and no changes requested.

github-actions[bot] avatar Feb 08 '24 03:02 github-actions[bot]

run buildall

deardeng avatar Feb 20 '24 12:02 deardeng

TPC-H: Total hot run time: 41802 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f2bf32d3255701547e3fe1993224dd8323542976, data reload: false

------ Round 1 ----------------------------------
q1	17590	4964	4864	4864
q2	2043	143	139	139
q3	10895	1057	1054	1054
q4	5280	1041	1021	1021
q5	8368	3391	3386	3386
q6	202	139	141	139
q7	1287	801	782	782
q8	9287	2088	2085	2085
q9	7632	6731	6677	6677
q10	8313	2641	2636	2636
q11	409	225	205	205
q12	817	323	330	323
q13	18005	3709	3655	3655
q14	292	256	259	256
q15	585	508	492	492
q16	481	419	412	412
q17	936	832	850	832
q18	7322	6751	6744	6744
q19	1549	1493	1502	1493
q20	512	363	349	349
q21	6024	3910	3992	3910
q22	406	356	348	348
Total cold run time: 108235 ms
Total hot run time: 41802 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5045	4835	4847	4835
q2	295	192	189	189
q3	3599	3598	3585	3585
q4	2549	2540	2526	2526
q5	5776	5758	5856	5758
q6	210	131	134	131
q7	2266	1671	1671	1671
q8	3026	3114	3101	3101
q9	8723	8711	8707	8707
q10	4132	4257	4248	4248
q11	514	371	347	347
q12	777	549	548	548
q13	4179	3437	3411	3411
q14	278	245	244	244
q15	591	530	506	506
q16	486	444	441	441
q17	1716	1631	1628	1628
q18	8361	7627	7614	7614
q19	1634	1641	1644	1641
q20	2125	1848	1872	1848
q21	6547	6175	6143	6143
q22	572	518	507	507
Total cold run time: 63401 ms
Total hot run time: 59629 ms

doris-robot avatar Feb 20 '24 12:02 doris-robot

TPC-DS: Total hot run time: 177628 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f2bf32d3255701547e3fe1993224dd8323542976, data reload: false

query1	942	356	348	348
query2	6505	1767	1767	1767
query3	6709	215	197	197
query4	23188	21078	21002	21002
query5	4258	461	455	455
query6	263	167	175	167
query7	4611	300	288	288
query8	252	198	194	194
query9	8426	2843	2841	2841
query10	425	228	228	228
query11	15027	14445	14555	14445
query12	136	86	85	85
query13	1683	417	424	417
query14	9100	7603	7651	7603
query15	213	179	192	179
query16	7499	252	253	252
query17	1412	550	538	538
query18	1960	267	263	263
query19	196	147	147	147
query20	86	83	85	83
query21	190	124	123	123
query22	4704	4628	4744	4628
query23	32753	31563	31764	31563
query24	12663	3373	3344	3344
query25	611	363	369	363
query26	1763	153	156	153
query27	3056	306	312	306
query28	6753	1861	1838	1838
query29	1132	603	609	603
query30	274	135	150	135
query31	979	745	757	745
query32	95	61	60	60
query33	729	239	242	239
query34	1074	485	500	485
query35	940	811	819	811
query36	1024	915	849	849
query37	139	60	58	58
query38	3314	3216	3221	3216
query39	1381	1310	1310	1310
query40	285	106	109	106
query41	40	35	35	35
query42	106	102	102	102
query43	467	447	447	447
query44	1068	693	714	693
query45	202	189	181	181
query46	1044	769	772	769
query47	1632	1568	1568	1568
query48	428	344	345	344
query49	1168	304	296	296
query50	797	391	365	365
query51	5267	5202	5182	5182
query52	107	96	92	92
query53	393	294	290	290
query54	297	220	222	220
query55	83	83	80	80
query56	222	207	199	199
query57	1021	928	985	928
query58	216	200	203	200
query59	2193	2268	2248	2248
query60	249	217	215	215
query61	86	93	84	84
query62	597	372	384	372
query63	329	289	281	281
query64	6526	3085	3154	3085
query65	3293	3263	3256	3256
query66	1375	330	323	323
query67	14585	14271	14471	14271
query68	5122	542	551	542
query69	528	360	358	358
query70	1255	1222	1258	1222
query71	325	257	278	257
query72	6403	2786	2645	2645
query73	721	311	303	303
query74	6869	6422	6578	6422
query75	3168	2554	2524	2524
query76	3063	1118	1178	1118
query77	347	232	229	229
query78	9456	8862	8831	8831
query79	957	504	487	487
query80	534	352	342	342
query81	441	208	201	201
query82	163	85	84	84
query83	144	121	123	121
query84	225	76	78	76
query85	1041	349	335	335
query86	303	300	300	300
query87	3444	3253	3267	3253
query88	2689	2276	2299	2276
query89	453	357	350	350
query90	1972	164	166	164
query91	154	126	130	126
query92	56	56	51	51
query93	1016	498	468	468
query94	1139	185	181	181
query95	8452	366	360	360
query96	574	261	262	261
query97	4415	4272	4270	4270
query98	220	207	198	198
query99	1087	770	713	713
Total cold run time: 277277 ms
Total hot run time: 177628 ms

doris-robot avatar Feb 20 '24 13:02 doris-robot

ClickBench: Total hot run time: 30.31 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f2bf32d3255701547e3fe1993224dd8323542976, data reload: false

query1	0.03	0.02	0.02
query2	0.07	0.02	0.03
query3	0.24	0.07	0.07
query4	1.63	0.08	0.09
query5	0.49	0.49	0.49
query6	1.41	0.61	0.61
query7	0.02	0.01	0.01
query8	0.04	0.02	0.02
query9	0.54	0.44	0.44
query10	0.48	0.49	0.49
query11	0.13	0.09	0.10
query12	0.12	0.10	0.10
query13	0.59	0.59	0.58
query14	0.76	0.78	0.77
query15	0.82	0.80	0.80
query16	0.33	0.33	0.34
query17	0.89	0.88	0.92
query18	0.19	0.16	0.18
query19	1.80	1.61	1.59
query20	0.02	0.01	0.01
query21	15.42	0.63	0.60
query22	3.17	4.55	1.90
query23	17.72	1.04	1.03
query24	2.40	0.29	0.27
query25	0.61	0.06	0.08
query26	0.16	0.14	0.14
query27	0.05	0.05	0.06
query28	11.88	0.83	0.82
query29	12.50	3.41	3.27
query30	0.53	0.50	0.49
query31	2.77	0.36	0.36
query32	3.32	0.48	0.47
query33	3.13	3.15	3.12
query34	15.38	4.49	4.50
query35	4.52	4.51	4.49
query36	1.07	0.94	0.93
query37	0.07	0.05	0.05
query38	0.04	0.03	0.03
query39	0.02	0.01	0.02
query40	0.17	0.14	0.15
query41	0.07	0.01	0.02
query42	0.03	0.02	0.01
query43	0.03	0.01	0.02
Total cold run time: 105.66 s
Total hot run time: 30.31 s

doris-robot avatar Feb 20 '24 13:02 doris-robot

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit f2bf32d3255701547e3fe1993224dd8323542976 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       13.5 seconds inserted 10000000 Rows, about 740K ops/s

doris-robot avatar Feb 20 '24 13:02 doris-robot

run buildall

deardeng avatar Feb 22 '24 13:02 deardeng

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar Feb 26 '24 09:02 github-actions[bot]

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar Feb 26 '24 09:02 github-actions[bot]