doris icon indicating copy to clipboard operation
doris copied to clipboard

[Feature](PreparedStatement) implement general server side prepared

Open eldenmoon opened this issue 9 months ago • 23 comments

fix rebase

Proposed changes

pick from #33807

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

eldenmoon avatar Apr 28 '24 09:04 eldenmoon

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar Apr 28 '24 09:04 doris-robot

run buildall

eldenmoon avatar Apr 28 '24 09:04 eldenmoon

TeamCity be ut coverage result: Function Coverage: 37.79% (8067/21349) Line Coverage: 29.46% (65896/223716) Region Coverage: 28.93% (33916/117252) Branch Coverage: 24.79% (17412/70226) Coverage Report: http://coverage.selectdb-in.cc/coverage/49cb762349389ccc867b6cdb9bc4ee9ef748dd90_49cb762349389ccc867b6cdb9bc4ee9ef748dd90/report/index.html

doris-robot avatar Apr 28 '24 10:04 doris-robot

TPC-H: Total hot run time: 49767 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 49cb762349389ccc867b6cdb9bc4ee9ef748dd90, data reload: false

------ Round 1 ----------------------------------
q1	17535	4410	4396	4396
q2	2036	149	143	143
q3	10273	1877	1906	1877
q4	10104	1268	1283	1268
q5	8410	3914	3912	3912
q6	231	121	125	121
q7	2068	1620	1594	1594
q8	9550	2708	2727	2708
q9	14020	11162	10372	10372
q10	8638	3516	3492	3492
q11	420	237	248	237
q12	468	301	302	301
q13	18359	3971	4036	3971
q14	345	325	323	323
q15	506	451	455	451
q16	656	572	568	568
q17	1136	963	929	929
q18	7223	7029	6814	6814
q19	1683	1541	1549	1541
q20	547	305	311	305
q21	4394	4149	4049	4049
q22	487	395	395	395
Total cold run time: 119089 ms
Total hot run time: 49767 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4348	4282	4323	4282
q2	316	225	226	225
q3	4195	4163	4197	4163
q4	2733	2759	2755	2755
q5	7180	7151	7090	7090
q6	240	120	122	120
q7	3231	2825	2869	2825
q8	4342	4469	4514	4469
q9	16942	16722	16778	16722
q10	4204	4253	4253	4253
q11	767	684	691	684
q12	1026	850	860	850
q13	6817	3748	3732	3732
q14	441	422	419	419
q15	497	461	457	457
q16	731	683	666	666
q17	3809	3863	3828	3828
q18	8829	8820	8776	8776
q19	1721	1661	1679	1661
q20	2380	2143	2095	2095
q21	8506	8546	8594	8546
q22	1027	927	924	924
Total cold run time: 84282 ms
Total hot run time: 79542 ms

doris-robot avatar Apr 28 '24 10:04 doris-robot

TPC-DS: Total hot run time: 203650 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 49cb762349389ccc867b6cdb9bc4ee9ef748dd90, data reload: false

query1	918	389	380	380
query2	6525	2907	2646	2646
query3	6913	200	195	195
query4	21683	17982	17983	17982
query5	19727	6436	6484	6436
query6	280	213	211	211
query7	4157	297	297	297
query8	260	277	235	235
query9	3165	2724	2647	2647
query10	415	299	291	291
query11	11220	10700	10747	10700
query12	118	78	69	69
query13	5566	695	666	666
query14	17570	13322	13179	13179
query15	350	230	223	223
query16	6457	273	250	250
query17	1714	1447	863	863
query18	2336	400	401	400
query19	196	144	142	142
query20	80	72	78	72
query21	183	93	93	93
query22	5318	5043	4992	4992
query23	32497	31986	32027	31986
query24	6967	6513	6458	6458
query25	516	437	424	424
query26	527	157	153	153
query27	1905	288	298	288
query28	6191	2384	2357	2357
query29	2930	2733	2796	2733
query30	250	159	159	159
query31	906	701	719	701
query32	68	58	58	58
query33	381	250	250	250
query34	849	459	473	459
query35	1119	937	908	908
query36	1389	1400	1155	1155
query37	88	66	57	57
query38	3114	2926	2861	2861
query39	1367	1319	1306	1306
query40	205	91	94	91
query41	38	34	34	34
query42	86	82	94	82
query43	728	637	693	637
query44	1119	721	724	721
query45	234	227	231	227
query46	1236	977	934	934
query47	2006	1688	1738	1688
query48	998	691	694	691
query49	615	361	378	361
query50	874	610	648	610
query51	4696	4694	4638	4638
query52	92	74	76	74
query53	436	313	316	313
query54	2635	2457	2426	2426
query55	87	74	74	74
query56	219	199	200	199
query57	1226	1077	1189	1077
query58	208	208	201	201
query59	4106	4247	3945	3945
query60	202	187	183	183
query61	87	83	81	81
query62	837	477	435	435
query63	475	323	325	323
query64	2532	1479	1463	1463
query65	3606	3523	3558	3523
query66	779	374	365	365
query67	18089	16435	16593	16435
query68	7325	663	672	663
query69	569	360	347	347
query70	1640	1434	1453	1434
query71	361	294	301	294
query72	6497	3403	3442	3403
query73	732	320	313	313
query74	6338	5929	5916	5916
query75	4517	3766	3719	3719
query76	4561	1091	1118	1091
query77	529	237	248	237
query78	12558	11573	11609	11573
query79	9073	640	638	638
query80	2346	383	377	377
query81	502	229	234	229
query82	1712	104	99	99
query83	171	131	131	131
query84	252	66	69	66
query85	1287	291	294	291
query86	344	290	313	290
query87	3210	3042	3028	3028
query88	5145	2307	2281	2281
query89	393	297	296	296
query90	1764	199	200	199
query91	164	148	133	133
query92	59	52	48	48
query93	5981	592	608	592
query94	838	203	206	203
query95	1092	1056	1036	1036
query96	660	320	323	320
query97	6462	6369	6295	6295
query98	189	176	173	173
query99	2934	955	822	822
Total cold run time: 314871 ms
Total hot run time: 203650 ms

doris-robot avatar Apr 28 '24 10:04 doris-robot

ClickBench: Total hot run time: 30.34 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 49cb762349389ccc867b6cdb9bc4ee9ef748dd90, data reload: false

query1	0.03	0.02	0.02
query2	0.07	0.03	0.02
query3	0.24	0.04	0.04
query4	1.80	0.07	0.06
query5	0.56	0.52	0.52
query6	1.22	0.68	0.61
query7	0.02	0.01	0.01
query8	0.04	0.03	0.02
query9	0.51	0.50	0.47
query10	0.55	0.54	0.53
query11	0.12	0.08	0.09
query12	0.13	0.09	0.09
query13	0.61	0.61	0.61
query14	0.79	0.78	0.80
query15	0.77	0.75	0.75
query16	0.39	0.38	0.38
query17	1.01	1.03	1.03
query18	0.25	0.25	0.26
query19	1.93	1.81	1.86
query20	0.01	0.02	0.01
query21	15.50	0.59	0.55
query22	2.03	1.94	1.63
query23	17.04	0.91	0.82
query24	6.48	1.36	0.68
query25	0.37	0.09	0.07
query26	0.72	0.17	0.16
query27	0.05	0.04	0.05
query28	6.64	0.76	0.73
query29	12.61	2.33	2.18
query30	0.60	0.56	0.56
query31	2.82	0.39	0.38
query32	3.36	0.50	0.50
query33	3.09	3.07	3.06
query34	15.26	4.80	4.78
query35	4.87	4.85	4.84
query36	1.06	1.02	1.02
query37	0.06	0.04	0.05
query38	0.03	0.02	0.02
query39	0.01	0.01	0.02
query40	0.16	0.14	0.14
query41	0.06	0.01	0.02
query42	0.02	0.01	0.01
query43	0.02	0.02	0.02
Total cold run time: 103.91 s
Total hot run time: 30.34 s

doris-robot avatar Apr 28 '24 10:04 doris-robot

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 49cb762349389ccc867b6cdb9bc4ee9ef748dd90 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.6 seconds inserted 10000000 Rows, about 462K ops/s

doris-robot avatar Apr 28 '24 10:04 doris-robot

run buildall

eldenmoon avatar Apr 29 '24 09:04 eldenmoon

run buildall

eldenmoon avatar Apr 29 '24 09:04 eldenmoon

TeamCity be ut coverage result: Function Coverage: 37.80% (8069/21349) Line Coverage: 29.46% (65907/223715) Region Coverage: 28.94% (33929/117254) Branch Coverage: 24.80% (17417/70226) Coverage Report: http://coverage.selectdb-in.cc/coverage/c068e1cb8fd4c27e6b02e16a01b71b400a10780c_c068e1cb8fd4c27e6b02e16a01b71b400a10780c/report/index.html

doris-robot avatar Apr 29 '24 10:04 doris-robot

run buildall

eldenmoon avatar Apr 29 '24 13:04 eldenmoon

TeamCity be ut coverage result: Function Coverage: 37.79% (8069/21352) Line Coverage: 29.45% (65898/223763) Region Coverage: 28.93% (33927/117285) Branch Coverage: 24.79% (17414/70252) Coverage Report: http://coverage.selectdb-in.cc/coverage/6bff147ba505d113aa21fb18c1e067e1802ef68c_6bff147ba505d113aa21fb18c1e067e1802ef68c/report/index.html

doris-robot avatar Apr 29 '24 14:04 doris-robot

TPC-H: Total hot run time: 49658 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6bff147ba505d113aa21fb18c1e067e1802ef68c, data reload: false

------ Round 1 ----------------------------------
q1	17661	4502	4379	4379
q2	2020	157	147	147
q3	10476	1902	1959	1902
q4	10327	1267	1383	1267
q5	8519	3872	3951	3872
q6	237	129	129	129
q7	2062	1602	1603	1602
q8	9366	2747	2779	2747
q9	10683	10342	10235	10235
q10	8625	3546	3482	3482
q11	420	243	245	243
q12	466	299	305	299
q13	18362	3923	4013	3923
q14	348	316	325	316
q15	506	460	451	451
q16	671	569	562	562
q17	1136	984	955	955
q18	7209	6852	6798	6798
q19	1750	1595	1559	1559
q20	503	300	304	300
q21	4513	4136	4107	4107
q22	496	391	383	383
Total cold run time: 116356 ms
Total hot run time: 49658 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4352	4307	4306	4306
q2	320	227	216	216
q3	4166	4155	4115	4115
q4	2760	2750	2759	2750
q5	7184	7028	7077	7028
q6	241	125	122	122
q7	3238	2814	2809	2809
q8	4381	4485	4520	4485
q9	17014	16785	16690	16690
q10	4252	4256	4278	4256
q11	778	704	659	659
q12	1040	842	852	842
q13	7495	3747	3746	3746
q14	444	436	429	429
q15	499	458	464	458
q16	744	682	669	669
q17	3836	3782	3873	3782
q18	8754	8872	8806	8806
q19	1752	1744	1676	1676
q20	2346	2163	2158	2158
q21	8556	8412	8537	8412
q22	1042	949	973	949
Total cold run time: 85194 ms
Total hot run time: 79363 ms

doris-robot avatar Apr 29 '24 14:04 doris-robot

TPC-DS: Total hot run time: 202062 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6bff147ba505d113aa21fb18c1e067e1802ef68c, data reload: false

query1	930	380	380	380
query2	6538	2898	2563	2563
query3	6914	199	200	199
query4	21368	18067	18042	18042
query5	19720	6480	6571	6480
query6	278	218	225	218
query7	4148	313	293	293
query8	257	226	243	226
query9	3139	2675	2599	2599
query10	421	283	307	283
query11	11338	10608	10626	10608
query12	114	79	69	69
query13	5582	700	682	682
query14	17657	13197	13629	13197
query15	363	231	221	221
query16	6452	282	259	259
query17	1717	1448	889	889
query18	2303	408	403	403
query19	200	146	150	146
query20	74	77	75	75
query21	189	95	98	95
query22	5251	5028	4976	4976
query23	32442	31850	31815	31815
query24	6901	6525	6488	6488
query25	531	418	411	411
query26	521	168	163	163
query27	1801	297	298	297
query28	6207	2358	2298	2298
query29	2897	2847	2796	2796
query30	240	160	159	159
query31	912	721	721	721
query32	69	61	58	58
query33	400	264	247	247
query34	842	466	475	466
query35	1114	962	944	944
query36	1206	1231	1036	1036
query37	94	66	57	57
query38	3150	2942	2882	2882
query39	1363	1321	1314	1314
query40	207	99	92	92
query41	47	36	34	34
query42	86	83	79	79
query43	742	632	710	632
query44	1130	725	726	725
query45	234	227	223	223
query46	1216	963	970	963
query47	1833	1817	1659	1659
query48	1016	725	713	713
query49	622	355	374	355
query50	867	609	595	595
query51	4789	4661	4569	4569
query52	95	73	91	73
query53	449	325	329	325
query54	2672	2430	2409	2409
query55	93	77	81	77
query56	210	206	211	206
query57	1238	1088	1014	1014
query58	220	212	194	194
query59	3986	3784	4177	3784
query60	206	193	197	193
query61	92	86	86	86
query62	834	483	547	483
query63	472	341	341	341
query64	2311	1614	1503	1503
query65	3616	3535	3575	3535
query66	761	361	389	361
query67	15422	16961	15367	15367
query68	7447	660	673	660
query69	567	336	343	336
query70	1532	1461	1395	1395
query71	402	299	306	299
query72	6527	3413	3444	3413
query73	733	326	320	320
query74	6356	5802	5823	5802
query75	4726	3670	3712	3670
query76	4527	1125	1179	1125
query77	550	247	253	247
query78	12647	11738	11573	11573
query79	6990	670	635	635
query80	2581	411	396	396
query81	526	229	232	229
query82	1316	100	95	95
query83	191	135	135	135
query84	266	67	66	66
query85	1393	297	293	293
query86	363	298	295	295
query87	3200	3000	2982	2982
query88	5048	2300	2304	2300
query89	346	286	295	286
query90	1704	217	214	214
query91	171	136	138	136
query92	58	54	53	53
query93	2368	597	585	585
query94	896	205	204	204
query95	1101	1076	1038	1038
query96	639	320	316	316
query97	6482	6376	6331	6331
query98	195	180	167	167
query99	3001	821	885	821
Total cold run time: 305958 ms
Total hot run time: 202062 ms

doris-robot avatar Apr 29 '24 14:04 doris-robot

ClickBench: Total hot run time: 31.16 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6bff147ba505d113aa21fb18c1e067e1802ef68c, data reload: false

query1	0.02	0.02	0.02
query2	0.06	0.02	0.02
query3	0.24	0.04	0.05
query4	1.81	0.07	0.06
query5	0.53	0.52	0.52
query6	1.23	0.63	0.62
query7	0.02	0.02	0.01
query8	0.03	0.03	0.03
query9	0.53	0.48	0.47
query10	0.53	0.54	0.55
query11	0.12	0.09	0.09
query12	0.11	0.09	0.10
query13	0.62	0.61	0.61
query14	0.78	0.80	0.80
query15	0.77	0.76	0.76
query16	0.37	0.36	0.36
query17	1.02	1.01	0.98
query18	0.22	0.26	0.25
query19	1.97	1.86	1.82
query20	0.02	0.01	0.00
query21	15.48	0.57	0.56
query22	2.02	2.32	1.49
query23	17.11	0.96	0.93
query24	4.64	4.80	1.67
query25	0.43	0.05	0.07
query26	0.97	0.15	0.14
query27	0.05	0.04	0.04
query28	4.14	0.73	0.79
query29	12.66	2.31	2.20
query30	0.56	0.52	0.51
query31	2.79	0.40	0.36
query32	3.41	0.50	0.49
query33	3.06	3.08	3.02
query34	15.25	4.79	4.78
query35	4.86	4.85	4.84
query36	1.07	1.02	1.02
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.15	0.14
query41	0.06	0.01	0.01
query42	0.02	0.01	0.01
query43	0.02	0.02	0.01
Total cold run time: 99.88 s
Total hot run time: 31.16 s

doris-robot avatar Apr 29 '24 14:04 doris-robot

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 6bff147ba505d113aa21fb18c1e067e1802ef68c with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.1 seconds inserted 10000000 Rows, about 473K ops/s

doris-robot avatar Apr 29 '24 14:04 doris-robot

run buildall

eldenmoon avatar Apr 30 '24 14:04 eldenmoon

run buildall

eldenmoon avatar Apr 30 '24 15:04 eldenmoon

TeamCity be ut coverage result: Function Coverage: 37.80% (8071/21352) Line Coverage: 29.46% (65924/223760) Region Coverage: 28.94% (33941/117289) Branch Coverage: 24.80% (17422/70248) Coverage Report: http://coverage.selectdb-in.cc/coverage/3b893136617682c056a4c17d8ee7d330f7d36091_3b893136617682c056a4c17d8ee7d330f7d36091/report/index.html

doris-robot avatar Apr 30 '24 15:04 doris-robot

TPC-H: Total hot run time: 49601 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3b893136617682c056a4c17d8ee7d330f7d36091, data reload: false

------ Round 1 ----------------------------------
q1	17931	4438	4334	4334
q2	2046	156	144	144
q3	10458	1890	1934	1890
q4	10291	1216	1325	1216
q5	8609	3824	3914	3824
q6	236	125	120	120
q7	2011	1634	1597	1597
q8	9330	2717	2715	2715
q9	10587	10590	10303	10303
q10	8621	3516	3481	3481
q11	426	233	251	233
q12	466	301	301	301
q13	18393	3987	4058	3987
q14	346	320	325	320
q15	524	460	452	452
q16	689	570	578	570
q17	1147	975	956	956
q18	7333	6862	6984	6862
q19	1705	1589	1539	1539
q20	508	298	307	298
q21	4441	4170	4084	4084
q22	500	375	388	375
Total cold run time: 116598 ms
Total hot run time: 49601 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4336	4321	4284	4284
q2	321	224	218	218
q3	4130	4172	4159	4159
q4	2736	2734	2743	2734
q5	7221	7113	7134	7113
q6	236	119	116	116
q7	3203	2886	2827	2827
q8	4395	4480	4533	4480
q9	16850	16738	16815	16738
q10	4249	4286	4262	4262
q11	781	688	672	672
q12	1060	872	842	842
q13	6644	3737	3766	3737
q14	455	430	430	430
q15	511	455	461	455
q16	743	687	667	667
q17	3901	3872	3857	3857
q18	8774	8856	8712	8712
q19	1716	1715	1666	1666
q20	2353	2192	2148	2148
q21	8528	8451	8548	8451
q22	1021	933	916	916
Total cold run time: 84164 ms
Total hot run time: 79484 ms

doris-robot avatar Apr 30 '24 15:04 doris-robot

TPC-DS: Total hot run time: 202205 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3b893136617682c056a4c17d8ee7d330f7d36091, data reload: false

query1	957	386	379	379
query2	6521	2830	2619	2619
query3	6911	202	201	201
query4	20148	18071	17858	17858
query5	19700	6503	6461	6461
query6	277	209	226	209
query7	4151	298	304	298
query8	294	238	229	229
query9	3150	2710	2651	2651
query10	415	298	299	298
query11	11304	10652	10757	10652
query12	125	70	72	70
query13	5581	698	687	687
query14	17457	13655	13720	13655
query15	356	220	232	220
query16	6473	271	255	255
query17	1721	1468	879	879
query18	2313	401	399	399
query19	209	145	143	143
query20	74	76	77	76
query21	196	95	88	88
query22	5215	4994	4986	4986
query23	32582	31965	31743	31743
query24	7065	6450	6523	6450
query25	522	431	401	401
query26	534	165	154	154
query27	1904	290	290	290
query28	6151	2387	2341	2341
query29	2816	2760	2721	2721
query30	239	162	161	161
query31	909	736	704	704
query32	72	53	58	53
query33	392	262	248	248
query34	854	465	478	465
query35	1120	874	921	874
query36	1286	1220	1379	1220
query37	89	60	58	58
query38	3046	2926	2908	2908
query39	1375	1329	1335	1329
query40	191	99	98	98
query41	38	34	35	34
query42	88	80	82	80
query43	696	768	689	689
query44	1113	722	723	722
query45	244	224	224	224
query46	1217	961	983	961
query47	1818	1811	1745	1745
query48	1022	738	705	705
query49	622	369	364	364
query50	854	593	590	590
query51	4761	4626	4666	4626
query52	89	87	77	77
query53	442	314	316	314
query54	2653	2473	2463	2463
query55	90	80	78	78
query56	218	214	206	206
query57	1200	1082	1083	1082
query58	212	178	190	178
query59	4151	3783	3749	3749
query60	206	204	189	189
query61	88	79	79	79
query62	798	464	489	464
query63	471	332	331	331
query64	2555	1607	1471	1471
query65	3610	3594	3575	3575
query66	764	366	379	366
query67	16278	15935	15035	15035
query68	8485	656	689	656
query69	573	353	372	353
query70	1566	1355	1280	1280
query71	401	308	315	308
query72	6451	3422	3412	3412
query73	728	316	322	316
query74	6317	5917	5880	5880
query75	4814	3685	3645	3645
query76	4842	1146	1242	1146
query77	683	253	243	243
query78	12492	11763	11348	11348
query79	9270	644	639	639
query80	2273	390	393	390
query81	496	232	231	231
query82	1678	98	98	98
query83	167	133	128	128
query84	260	68	66	66
query85	988	290	283	283
query86	347	286	316	286
query87	3247	3121	3069	3069
query88	5228	2344	2335	2335
query89	383	301	280	280
query90	1882	204	203	203
query91	175	132	142	132
query92	60	55	49	49
query93	6415	586	573	573
query94	766	198	203	198
query95	1108	1070	1047	1047
query96	655	327	323	323
query97	6418	6385	6305	6305
query98	188	179	167	167
query99	3068	888	921	888
Total cold run time: 313417 ms
Total hot run time: 202205 ms

doris-robot avatar Apr 30 '24 16:04 doris-robot

ClickBench: Total hot run time: 30.28 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3b893136617682c056a4c17d8ee7d330f7d36091, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.25	0.04	0.04
query4	1.80	0.06	0.07
query5	0.52	0.52	0.52
query6	1.26	0.63	0.62
query7	0.01	0.01	0.01
query8	0.03	0.02	0.02
query9	0.51	0.48	0.48
query10	0.54	0.54	0.55
query11	0.12	0.08	0.08
query12	0.12	0.09	0.09
query13	0.61	0.62	0.60
query14	0.77	0.78	0.78
query15	0.77	0.76	0.77
query16	0.37	0.37	0.37
query17	1.01	0.99	1.02
query18	0.24	0.25	0.27
query19	1.91	1.83	1.85
query20	0.02	0.01	0.01
query21	15.46	0.60	0.56
query22	1.97	1.96	1.54
query23	16.88	1.03	0.87
query24	7.24	0.64	1.23
query25	0.35	0.09	0.05
query26	0.77	0.15	0.15
query27	0.05	0.05	0.04
query28	6.03	0.74	0.72
query29	12.66	2.31	2.33
query30	0.62	0.51	0.52
query31	2.82	0.38	0.38
query32	3.38	0.50	0.49
query33	3.09	3.07	3.05
query34	15.26	4.79	4.82
query35	4.85	4.84	4.83
query36	1.08	1.02	1.02
query37	0.06	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.14	0.14
query41	0.06	0.01	0.01
query42	0.03	0.02	0.01
query43	0.03	0.01	0.02
Total cold run time: 103.85 s
Total hot run time: 30.28 s

doris-robot avatar Apr 30 '24 16:04 doris-robot

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 3b893136617682c056a4c17d8ee7d330f7d36091 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.5 seconds inserted 10000000 Rows, about 465K ops/s

doris-robot avatar Apr 30 '24 16:04 doris-robot

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar May 03 '24 04:05 github-actions[bot]

PR approved by anyone and no changes requested.

github-actions[bot] avatar May 03 '24 04:05 github-actions[bot]

run buildall

eldenmoon avatar May 07 '24 03:05 eldenmoon

run buildall

eldenmoon avatar May 07 '24 03:05 eldenmoon

TeamCity be ut coverage result: Function Coverage: 37.80% (8076/21364) Line Coverage: 29.44% (65920/223883) Region Coverage: 28.91% (33936/117382) Branch Coverage: 24.76% (17410/70308) Coverage Report: http://coverage.selectdb-in.cc/coverage/4dd5245b57fea4542e73e0eefb3d942229b4c00d_4dd5245b57fea4542e73e0eefb3d942229b4c00d/report/index.html

doris-robot avatar May 07 '24 04:05 doris-robot

TPC-H: Total hot run time: 50250 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4dd5245b57fea4542e73e0eefb3d942229b4c00d, data reload: false

------ Round 1 ----------------------------------
q1	17713	4380	4334	4334
q2	2026	150	141	141
q3	10492	1883	1943	1883
q4	10379	1257	1309	1257
q5	8966	4011	3880	3880
q6	230	121	122	121
q7	2072	1596	1617	1596
q8	9565	2726	2740	2726
q9	14389	10520	10435	10435
q10	8657	3521	3549	3521
q11	417	246	247	246
q12	470	301	309	301
q13	19613	3969	4120	3969
q14	368	334	347	334
q15	506	469	468	468
q16	701	611	616	611
q17	1138	951	924	924
q18	7736	7316	7112	7112
q19	1711	1558	1541	1541
q20	560	312	307	307
q21	4458	4187	4139	4139
q22	502	404	450	404
Total cold run time: 122669 ms
Total hot run time: 50250 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4438	4307	4320	4307
q2	319	215	214	214
q3	4167	4120	4134	4120
q4	2746	2740	2729	2729
q5	7227	7112	7080	7080
q6	233	117	118	117
q7	3273	2771	2848	2771
q8	4346	4449	4469	4449
q9	16899	16858	16807	16807
q10	4240	4244	4261	4244
q11	766	675	687	675
q12	1026	873	862	862
q13	6864	3743	3729	3729
q14	465	431	424	424
q15	492	452	456	452
q16	731	678	666	666
q17	3820	3850	3825	3825
q18	8772	8667	8849	8667
q19	1743	1680	1642	1642
q20	2383	2138	2122	2122
q21	8494	8499	8390	8390
q22	1057	964	938	938
Total cold run time: 84501 ms
Total hot run time: 79230 ms

doris-robot avatar May 07 '24 04:05 doris-robot

TPC-DS: Total hot run time: 202201 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4dd5245b57fea4542e73e0eefb3d942229b4c00d, data reload: false

query1	931	389	380	380
query2	6519	3011	2573	2573
query3	6916	201	201	201
query4	20464	17904	17941	17904
query5	19714	6476	6498	6476
query6	279	219	228	219
query7	4156	299	289	289
query8	291	257	223	223
query9	3064	2661	2585	2585
query10	401	302	302	302
query11	11288	10620	10688	10620
query12	120	78	71	71
query13	5605	686	690	686
query14	17422	13174	13615	13174
query15	378	214	227	214
query16	6505	272	254	254
query17	1571	1461	869	869
query18	2295	402	396	396
query19	218	140	153	140
query20	79	77	78	77
query21	189	89	88	88
query22	5201	5087	5118	5087
query23	32437	32025	31975	31975
query24	7039	6522	6511	6511
query25	504	415	408	408
query26	496	159	158	158
query27	1815	293	294	293
query28	6151	2410	2364	2364
query29	2905	2711	2764	2711
query30	237	166	162	162
query31	882	720	714	714
query32	65	60	61	60
query33	398	249	233	233
query34	842	476	472	472
query35	1100	924	938	924
query36	1391	1332	1211	1211
query37	91	60	67	60
query38	3073	2937	2923	2923
query39	1362	1325	1331	1325
query40	202	98	94	94
query41	37	35	35	35
query42	82	85	81	81
query43	766	673	722	673
query44	1139	723	719	719
query45	242	222	225	222
query46	1231	941	946	941
query47	1936	1764	1822	1764
query48	1009	739	700	700
query49	621	360	373	360
query50	877	593	604	593
query51	4753	4701	4598	4598
query52	83	80	73	73
query53	449	310	315	310
query54	2671	2429	2429	2429
query55	85	87	72	72
query56	224	204	199	199
query57	1179	1048	1115	1048
query58	210	210	187	187
query59	4135	4087	3770	3770
query60	201	179	213	179
query61	83	80	80	80
query62	783	472	492	472
query63	479	338	334	334
query64	2473	1504	1443	1443
query65	3639	3553	3538	3538
query66	771	372	370	370
query67	15731	15786	14709	14709
query68	9324	666	658	658
query69	555	360	364	360
query70	1617	1547	1435	1435
query71	386	298	311	298
query72	6431	3507	3440	3440
query73	730	320	317	317
query74	6352	5880	5855	5855
query75	5220	3684	3724	3684
query76	5981	1153	1245	1153
query77	1006	248	252	248
query78	12571	11996	11859	11859
query79	10844	648	642	642
query80	1198	392	381	381
query81	482	238	232	232
query82	1234	99	91	91
query83	153	134	127	127
query84	250	66	69	66
query85	840	312	296	296
query86	333	323	303	303
query87	3250	3011	3063	3011
query88	4787	2314	2304	2304
query89	425	289	276	276
query90	1958	206	199	199
query91	164	135	132	132
query92	60	50	50	50
query93	5595	555	602	555
query94	712	196	197	196
query95	1075	1051	1033	1033
query96	652	326	331	326
query97	6492	6319	6474	6319
query98	196	180	174	174
query99	3117	949	856	856
Total cold run time: 314475 ms
Total hot run time: 202201 ms

doris-robot avatar May 07 '24 04:05 doris-robot