doris icon indicating copy to clipboard operation
doris copied to clipboard

[improvement](cloud)Not allowed to operate internal_schema database

Open zddr opened this issue 1 year ago • 10 comments

Proposed changes

Issue Number: close #xxx

Inherited from: https://github.com/apache/doris/pull/29790

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

zddr avatar Feb 22 '24 08:02 zddr

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

doris-robot avatar Feb 22 '24 08:02 doris-robot

run buildall

zddr avatar Feb 22 '24 08:02 zddr

TPC-H: Total hot run time: 41566 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7600381925d0dd410fd34df6a5b65609aa5f2fab, data reload: false

------ Round 1 ----------------------------------
q1	18280	5241	5166	5166
q2	2635	147	139	139
q3	11642	985	983	983
q4	4661	966	981	966
q5	7637	3189	3198	3189
q6	193	137	134	134
q7	1252	772	764	764
q8	9238	2074	2070	2070
q9	7504	6612	6615	6612
q10	8331	2631	2641	2631
q11	409	217	214	214
q12	722	334	339	334
q13	17931	3624	3609	3609
q14	304	254	263	254
q15	588	510	500	500
q16	480	411	410	410
q17	923	891	865	865
q18	7319	6902	6713	6713
q19	1534	1489	1496	1489
q20	485	272	279	272
q21	5910	3923	3961	3923
q22	646	329	330	329
Total cold run time: 108624 ms
Total hot run time: 41566 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4939	4899	4884	4884
q2	294	182	194	182
q3	3604	3611	3590	3590
q4	2552	2544	2535	2535
q5	5777	5781	5777	5777
q6	214	130	127	127
q7	2259	1700	1672	1672
q8	3038	3115	3116	3115
q9	8723	8727	8710	8710
q10	4911	4242	4255	4242
q11	510	359	372	359
q12	787	536	553	536
q13	4168	3396	3422	3396
q14	257	244	221	221
q15	596	507	509	507
q16	489	468	450	450
q17	1674	1626	1621	1621
q18	8370	7730	7636	7636
q19	1642	1647	1653	1647
q20	2109	1835	1845	1835
q21	6562	6211	6169	6169
q22	562	488	499	488
Total cold run time: 64037 ms
Total hot run time: 59699 ms

doris-robot avatar Feb 22 '24 08:02 doris-robot

TPC-DS: Total hot run time: 177061 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7600381925d0dd410fd34df6a5b65609aa5f2fab, data reload: false

query1	928	365	347	347
query2	6506	1751	1756	1751
query3	6694	210	202	202
query4	23144	21186	21135	21135
query5	4289	384	377	377
query6	247	168	170	168
query7	4619	294	290	290
query8	250	198	199	198
query9	8439	2845	2830	2830
query10	414	231	218	218
query11	15004	14624	14513	14513
query12	140	87	81	81
query13	1694	410	425	410
query14	8947	7631	7673	7631
query15	212	197	191	191
query16	7109	248	244	244
query17	1425	540	535	535
query18	2091	277	268	268
query19	189	147	155	147
query20	87	82	83	82
query21	198	125	123	123
query22	4986	4916	4864	4864
query23	32621	31505	31558	31505
query24	12840	3433	3473	3433
query25	658	366	361	361
query26	1869	150	164	150
query27	3047	311	307	307
query28	6621	1859	1848	1848
query29	1243	621	615	615
query30	282	136	151	136
query31	932	748	744	744
query32	94	61	57	57
query33	727	242	235	235
query34	1073	482	493	482
query35	984	832	832	832
query36	1007	841	928	841
query37	244	61	64	61
query38	3257	3229	3181	3181
query39	1375	1350	1327	1327
query40	285	108	110	108
query41	37	36	34	34
query42	103	104	102	102
query43	476	448	455	448
query44	1065	685	689	685
query45	197	188	183	183
query46	1049	781	782	781
query47	1644	1567	1591	1567
query48	412	344	344	344
query49	1243	323	309	309
query50	779	370	370	370
query51	4407	4335	4337	4335
query52	112	95	98	95
query53	399	292	299	292
query54	287	230	247	230
query55	83	80	79	79
query56	234	198	203	198
query57	1053	981	947	947
query58	213	196	196	196
query59	2306	2256	2208	2208
query60	236	221	226	221
query61	89	82	83	82
query62	605	402	401	401
query63	324	278	283	278
query64	6437	3043	3111	3043
query65	3300	3255	3248	3248
query66	1392	331	326	326
query67	14664	14238	14279	14238
query68	5112	542	572	542
query69	518	356	353	353
query70	1203	1195	1256	1195
query71	320	256	252	252
query72	6252	2787	2582	2582
query73	689	308	306	306
query74	6942	6451	6497	6451
query75	3202	2553	2542	2542
query76	3260	1134	1206	1134
query77	346	250	239	239
query78	9413	8882	8766	8766
query79	971	513	504	504
query80	536	352	344	344
query81	437	208	203	203
query82	236	86	84	84
query83	141	125	123	123
query84	223	78	77	77
query85	1022	336	337	336
query86	307	304	297	297
query87	3423	3343	3301	3301
query88	2726	2293	2281	2281
query89	439	362	350	350
query90	1950	161	164	161
query91	156	128	128	128
query92	57	51	48	48
query93	1003	520	489	489
query94	1122	177	185	177
query95	443	328	341	328
query96	575	264	266	264
query97	4473	4266	4267	4266
query98	221	209	206	206
query99	1055	731	664	664
Total cold run time: 268690 ms
Total hot run time: 177061 ms

doris-robot avatar Feb 22 '24 08:02 doris-robot

ClickBench: Total hot run time: 30.82 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7600381925d0dd410fd34df6a5b65609aa5f2fab, data reload: false

query1	0.03	0.02	0.02
query2	0.06	0.02	0.02
query3	0.22	0.07	0.07
query4	1.64	0.09	0.10
query5	0.49	0.49	0.49
query6	1.37	0.60	0.62
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.52	0.44	0.45
query10	0.48	0.49	0.48
query11	0.13	0.10	0.10
query12	0.12	0.10	0.10
query13	0.59	0.58	0.59
query14	0.75	0.79	0.78
query15	0.82	0.80	0.80
query16	0.33	0.34	0.33
query17	0.96	0.89	0.95
query18	0.19	0.17	0.17
query19	1.70	1.68	1.64
query20	0.02	0.00	0.01
query21	15.41	0.67	0.62
query22	3.43	3.76	2.16
query23	17.36	1.05	1.00
query24	2.02	0.73	0.37
query25	0.63	0.06	0.05
query26	0.16	0.13	0.13
query27	0.06	0.05	0.05
query28	11.89	0.80	0.82
query29	12.67	3.34	3.36
query30	0.50	0.50	0.48
query31	2.78	0.36	0.36
query32	3.34	0.48	0.47
query33	3.13	3.18	3.12
query34	15.36	4.50	4.51
query35	4.52	4.52	4.49
query36	1.08	0.96	0.96
query37	0.06	0.05	0.05
query38	0.04	0.03	0.03
query39	0.02	0.02	0.02
query40	0.16	0.16	0.14
query41	0.07	0.02	0.01
query42	0.02	0.01	0.01
query43	0.03	0.02	0.02
Total cold run time: 105.22 s
Total hot run time: 30.82 s

doris-robot avatar Feb 22 '24 09:02 doris-robot

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 7600381925d0dd410fd34df6a5b65609aa5f2fab with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          60 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       13.1 seconds inserted 10000000 Rows, about 763K ops/s

doris-robot avatar Feb 22 '24 09:02 doris-robot

run buildall

zddr avatar Feb 22 '24 13:02 zddr

run buildall

zddr avatar Feb 23 '24 02:02 zddr

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar Feb 23 '24 08:02 github-actions[bot]

PR approved by anyone and no changes requested.

github-actions[bot] avatar Feb 23 '24 08:02 github-actions[bot]