doris icon indicating copy to clipboard operation
doris copied to clipboard

[improvement](spill) fuzzy spill and fix bugs

Open jacktengg opened this issue 10 months ago • 149 comments

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

jacktengg avatar Apr 06 '24 16:04 jacktengg

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar Apr 06 '24 16:04 doris-robot

run buildall

jacktengg avatar Apr 06 '24 16:04 jacktengg

TPC-H: Total hot run time: 38736 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7563f8e38c5069f01dd6ec4bdf89b3e4fefe13ba, data reload: false

------ Round 1 ----------------------------------
q1	17682	4145	4073	4073
q2	2018	186	179	179
q3	10484	1136	1365	1136
q4	10195	862	976	862
q5	7491	3002	2961	2961
q6	219	135	137	135
q7	1113	603	605	603
q8	9395	2076	2051	2051
q9	6710	6222	6156	6156
q10	8483	3581	3514	3514
q11	420	240	251	240
q12	382	214	210	210
q13	17784	2905	2897	2897
q14	265	234	239	234
q15	517	484	480	480
q16	499	396	368	368
q17	969	932	922	922
q18	7268	6506	6469	6469
q19	1635	1543	1549	1543
q20	563	325	325	325
q21	3488	3091	3073	3073
q22	353	305	311	305
Total cold run time: 107933 ms
Total hot run time: 38736 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4092	4080	4034	4034
q2	327	216	214	214
q3	2955	2935	2949	2935
q4	1862	1863	1838	1838
q5	5238	5220	5236	5220
q6	204	124	125	124
q7	2246	1803	1788	1788
q8	3222	3288	3265	3265
q9	8454	8482	8514	8482
q10	3739	4009	4046	4009
q11	557	456	445	445
q12	743	571	582	571
q13	16858	3087	3159	3087
q14	311	259	291	259
q15	534	506	503	503
q16	487	440	468	440
q17	1776	1756	1748	1748
q18	8283	7624	7655	7624
q19	1712	1698	1684	1684
q20	2009	1817	1857	1817
q21	5311	5014	4988	4988
q22	499	456	433	433
Total cold run time: 71419 ms
Total hot run time: 55508 ms

doris-robot avatar Apr 06 '24 18:04 doris-robot

TPC-DS: Total hot run time: 180630 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7563f8e38c5069f01dd6ec4bdf89b3e4fefe13ba, data reload: false

query1	1222	358	1108	358
query2	6355	2001	1880	1880
query3	6663	210	200	200
query4	24307	21334	21469	21334
query5	4168	386	395	386
query6	287	186	171	171
query7	4594	292	302	292
query8	238	183	174	174
query9	8483	2263	2246	2246
query10	445	236	252	236
query11	14970	14477	14432	14432
query12	138	87	88	87
query13	1641	375	378	375
query14	8535	6841	6910	6841
query15	214	169	169	169
query16	6800	262	262	262
query17	1018	591	563	563
query18	1841	278	271	271
query19	205	152	157	152
query20	91	89	92	89
query21	198	127	128	127
query22	4947	4850	4775	4775
query23	33482	32846	32732	32732
query24	10474	3211	3193	3193
query25	665	425	413	413
query26	952	172	159	159
query27	3093	367	374	367
query28	6943	1897	1918	1897
query29	1069	606	606	606
query30	306	169	177	169
query31	995	761	751	751
query32	100	55	58	55
query33	665	249	244	244
query34	1236	501	542	501
query35	833	726	720	720
query36	1031	878	869	869
query37	112	73	79	73
query38	3674	3575	3541	3541
query39	1617	1596	1598	1596
query40	175	136	132	132
query41	49	46	51	46
query42	114	110	110	110
query43	482	444	423	423
query44	1211	752	782	752
query45	284	276	288	276
query46	1077	818	829	818
query47	1946	1845	1845	1845
query48	378	306	301	301
query49	894	386	371	371
query50	818	398	410	398
query51	6814	6700	6766	6700
query52	103	93	87	87
query53	355	284	302	284
query54	263	225	234	225
query55	89	74	71	71
query56	243	226	231	226
query57	1285	1201	1166	1166
query58	235	218	215	215
query59	2739	2506	2398	2398
query60	253	228	227	227
query61	91	89	90	89
query62	654	441	459	441
query63	299	278	282	278
query64	4492	3183	3137	3137
query65	3035	2991	2994	2991
query66	846	316	310	310
query67	15255	14920	14998	14920
query68	9191	569	572	569
query69	579	322	312	312
query70	1450	1153	1099	1099
query71	478	266	263	263
query72	6982	2571	2371	2371
query73	1599	319	318	318
query74	6675	6276	6216	6216
query75	3579	2298	2261	2261
query76	5901	1084	1245	1084
query77	663	242	242	242
query78	10776	10175	10050	10050
query79	10062	523	523	523
query80	1675	418	444	418
query81	490	234	224	224
query82	391	94	91	91
query83	202	161	167	161
query84	265	84	82	82
query85	887	285	296	285
query86	350	286	290	286
query87	3713	3438	3499	3438
query88	3805	2279	2288	2279
query89	547	375	377	375
query90	1910	173	178	173
query91	130	98	98	98
query92	60	46	47	46
query93	6703	526	528	526
query94	1171	180	177	177
query95	438	314	307	307
query96	619	270	278	270
query97	2659	2514	2526	2514
query98	228	212	218	212
query99	1171	882	817	817
Total cold run time: 294435 ms
Total hot run time: 180630 ms

doris-robot avatar Apr 06 '24 18:04 doris-robot

TeamCity be ut coverage result: Function Coverage: 35.64% (8887/24935) Line Coverage: 27.36% (72968/266687) Region Coverage: 26.53% (37724/142178) Branch Coverage: 23.34% (19224/82370) Coverage Report: http://coverage.selectdb-in.cc/coverage/7563f8e38c5069f01dd6ec4bdf89b3e4fefe13ba_7563f8e38c5069f01dd6ec4bdf89b3e4fefe13ba/report/index.html

doris-robot avatar Apr 06 '24 18:04 doris-robot

ClickBench: Total hot run time: 29.44 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7563f8e38c5069f01dd6ec4bdf89b3e4fefe13ba, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.04	0.04
query3	0.23	0.05	0.05
query4	1.68	0.08	0.07
query5	0.49	0.48	0.49
query6	1.15	0.66	0.65
query7	0.02	0.02	0.01
query8	0.06	0.04	0.04
query9	0.56	0.50	0.52
query10	0.56	0.57	0.57
query11	0.15	0.12	0.11
query12	0.14	0.12	0.13
query13	0.62	0.59	0.60
query14	0.77	0.78	0.78
query15	0.84	0.83	0.85
query16	0.35	0.36	0.35
query17	0.96	1.00	0.98
query18	0.25	0.25	0.25
query19	1.77	1.70	1.72
query20	0.01	0.01	0.01
query21	15.40	0.64	0.63
query22	4.02	7.04	1.24
query23	17.87	1.29	1.17
query24	1.52	0.42	0.19
query25	0.16	0.07	0.08
query26	0.29	0.17	0.16
query27	0.07	0.07	0.08
query28	13.31	0.97	0.94
query29	12.54	3.34	3.29
query30	0.26	0.06	0.05
query31	2.87	0.38	0.38
query32	3.30	0.47	0.47
query33	2.87	2.84	2.89
query34	15.47	4.39	4.34
query35	4.37	4.39	4.41
query36	0.67	0.47	0.47
query37	0.18	0.15	0.14
query38	0.15	0.14	0.13
query39	0.04	0.04	0.03
query40	0.18	0.15	0.15
query41	0.10	0.04	0.05
query42	0.05	0.05	0.05
query43	0.04	0.04	0.03
Total cold run time: 106.45 s
Total hot run time: 29.44 s

doris-robot avatar Apr 06 '24 18:04 doris-robot

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 7563f8e38c5069f01dd6ec4bdf89b3e4fefe13ba with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       16.0 seconds inserted 10000000 Rows, about 625K ops/s

doris-robot avatar Apr 06 '24 18:04 doris-robot

run buildall

jacktengg avatar Apr 07 '24 02:04 jacktengg

TeamCity be ut coverage result: Function Coverage: 35.63% (8885/24935) Line Coverage: 27.36% (72954/266686) Region Coverage: 26.52% (37708/142177) Branch Coverage: 23.33% (19219/82370) Coverage Report: http://coverage.selectdb-in.cc/coverage/4bdb91326ceeced20d90db9bd2102e833499f60d_4bdb91326ceeced20d90db9bd2102e833499f60d/report/index.html

doris-robot avatar Apr 07 '24 02:04 doris-robot

TPC-H: Total hot run time: 38561 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4bdb91326ceeced20d90db9bd2102e833499f60d, data reload: false

------ Round 1 ----------------------------------
q1	17688	4090	4083	4083
q2	2014	195	183	183
q3	10470	1152	1245	1152
q4	10210	857	988	857
q5	7507	2990	2942	2942
q6	217	138	135	135
q7	1097	629	603	603
q8	9442	2034	2018	2018
q9	6964	6190	6199	6190
q10	8468	3576	3518	3518
q11	421	242	242	242
q12	382	217	212	212
q13	17782	2891	2923	2891
q14	268	234	237	234
q15	527	482	477	477
q16	508	370	378	370
q17	954	886	889	886
q18	7235	6566	6345	6345
q19	3539	1537	1530	1530
q20	551	321	305	305
q21	3572	3115	3088	3088
q22	357	300	302	300
Total cold run time: 110173 ms
Total hot run time: 38561 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4129	4063	4039	4039
q2	322	212	217	212
q3	2956	2962	2932	2932
q4	1869	1833	1827	1827
q5	5213	5210	5243	5210
q6	210	122	128	122
q7	2241	1792	1808	1792
q8	3197	3254	3252	3252
q9	8438	8475	8448	8448
q10	3787	4470	4013	4013
q11	570	461	465	461
q12	761	616	642	616
q13	17164	3138	3127	3127
q14	302	270	272	270
q15	529	484	502	484
q16	467	420	409	409
q17	1783	1781	1757	1757
q18	7991	7782	7653	7653
q19	1748	1665	1646	1646
q20	1976	1805	1824	1805
q21	5210	4899	5013	4899
q22	520	438	450	438
Total cold run time: 71383 ms
Total hot run time: 55412 ms

doris-robot avatar Apr 07 '24 02:04 doris-robot

TPC-DS: Total hot run time: 180915 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4bdb91326ceeced20d90db9bd2102e833499f60d, data reload: false

query1	1214	370	1112	370
query2	6194	2004	1950	1950
query3	6662	205	203	203
query4	24683	21374	21448	21374
query5	4170	397	407	397
query6	270	190	175	175
query7	4612	299	297	297
query8	233	170	181	170
query9	8478	2250	2263	2250
query10	454	251	244	244
query11	14961	14443	14434	14434
query12	140	88	86	86
query13	1636	364	362	362
query14	8495	6865	6972	6865
query15	208	171	183	171
query16	6720	269	268	268
query17	999	591	569	569
query18	1848	283	277	277
query19	195	156	159	156
query20	92	89	87	87
query21	197	140	130	130
query22	4934	4852	4843	4843
query23	33439	33122	32590	32590
query24	11702	3234	3228	3228
query25	711	432	433	432
query26	1903	166	158	158
query27	3287	375	370	370
query28	7358	1872	1869	1869
query29	1302	598	636	598
query30	307	168	172	168
query31	987	781	752	752
query32	101	57	55	55
query33	667	243	243	243
query34	1331	518	526	518
query35	855	706	716	706
query36	998	882	885	882
query37	276	73	71	71
query38	3562	3691	3535	3535
query39	1650	1570	1588	1570
query40	243	138	129	129
query41	54	45	45	45
query42	112	105	107	105
query43	467	432	426	426
query44	1205	763	769	763
query45	291	288	274	274
query46	1113	827	813	813
query47	1963	1843	1862	1843
query48	372	307	304	304
query49	972	375	387	375
query50	822	413	403	403
query51	6824	6721	6721	6721
query52	108	96	96	96
query53	363	298	288	288
query54	282	239	240	239
query55	86	80	82	80
query56	251	242	233	233
query57	1255	1202	1141	1141
query58	231	212	220	212
query59	2857	2427	2346	2346
query60	244	228	232	228
query61	95	90	89	89
query62	671	446	462	446
query63	305	288	286	286
query64	5790	3191	3157	3157
query65	3077	3007	3016	3007
query66	1311	322	318	318
query67	15282	14760	14717	14717
query68	7756	560	584	560
query69	559	314	300	300
query70	1342	1096	1133	1096
query71	521	273	272	272
query72	6260	2553	2409	2409
query73	795	320	321	320
query74	6784	6283	6493	6283
query75	3595	2271	2332	2271
query76	6059	1240	1246	1240
query77	636	246	245	245
query78	10899	10130	10102	10102
query79	9797	527	536	527
query80	1851	434	430	430
query81	522	238	230	230
query82	685	91	95	91
query83	206	166	165	165
query84	269	88	84	84
query85	1373	293	281	281
query86	452	285	297	285
query87	3725	3531	3472	3472
query88	4164	2251	2282	2251
query89	553	368	373	368
query90	1931	185	179	179
query91	133	106	107	106
query92	59	52	47	47
query93	6802	527	522	522
query94	1041	176	179	176
query95	422	322	307	307
query96	624	267	267	267
query97	2682	2464	2502	2464
query98	235	220	228	220
query99	1309	838	838	838
Total cold run time: 298518 ms
Total hot run time: 180915 ms

doris-robot avatar Apr 07 '24 02:04 doris-robot

ClickBench: Total hot run time: 29.84 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4bdb91326ceeced20d90db9bd2102e833499f60d, data reload: false

query1	0.04	0.04	0.03
query2	0.09	0.04	0.04
query3	0.24	0.06	0.05
query4	1.66	0.08	0.08
query5	0.48	0.48	0.48
query6	1.16	0.66	0.66
query7	0.03	0.01	0.01
query8	0.05	0.04	0.04
query9	0.57	0.50	0.50
query10	0.54	0.56	0.57
query11	0.16	0.12	0.11
query12	0.14	0.12	0.12
query13	0.61	0.60	0.60
query14	0.77	0.78	0.81
query15	0.86	0.84	0.83
query16	0.35	0.35	0.36
query17	1.00	1.00	1.00
query18	0.25	0.24	0.27
query19	1.88	1.74	1.72
query20	0.02	0.01	0.01
query21	15.40	0.64	0.63
query22	3.78	6.90	1.42
query23	17.92	1.35	1.33
query24	1.61	0.21	0.19
query25	0.15	0.08	0.07
query26	0.27	0.16	0.16
query27	0.08	0.07	0.08
query28	13.80	0.96	0.95
query29	12.57	3.31	3.28
query30	0.26	0.06	0.06
query31	2.86	0.40	0.37
query32	3.27	0.47	0.47
query33	2.90	2.89	2.96
query34	15.50	4.33	4.34
query35	4.37	4.39	4.37
query36	0.69	0.47	0.47
query37	0.18	0.15	0.16
query38	0.16	0.14	0.13
query39	0.04	0.03	0.04
query40	0.18	0.15	0.18
query41	0.09	0.04	0.04
query42	0.06	0.04	0.05
query43	0.04	0.03	0.04
Total cold run time: 107.08 s
Total hot run time: 29.84 s

doris-robot avatar Apr 07 '24 03:04 doris-robot

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 4bdb91326ceeced20d90db9bd2102e833499f60d with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       17.0 seconds inserted 10000000 Rows, about 588K ops/s

doris-robot avatar Apr 07 '24 03:04 doris-robot

run buildall

jacktengg avatar Apr 07 '24 07:04 jacktengg

TPC-H: Total hot run time: 38419 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5c3196f917b933a2cd6b40925fcea2c658135e0d, data reload: false

------ Round 1 ----------------------------------
q1	17596	4138	4082	4082
q2	2016	187	179	179
q3	10473	1162	1286	1162
q4	10207	819	1002	819
q5	7556	2920	2949	2920
q6	217	129	131	129
q7	1090	651	613	613
q8	9414	2010	2049	2010
q9	6784	6233	6163	6163
q10	8450	3507	3522	3507
q11	420	235	231	231
q12	389	204	202	202
q13	17783	2923	2921	2921
q14	265	232	228	228
q15	509	481	487	481
q16	512	382	371	371
q17	960	910	861	861
q18	7273	6464	6385	6385
q19	1612	1551	1520	1520
q20	569	309	296	296
q21	3547	3076	3046	3046
q22	335	293	294	293
Total cold run time: 107977 ms
Total hot run time: 38419 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4066	4031	4068	4031
q2	332	219	219	219
q3	2976	2962	2927	2927
q4	1880	1850	1822	1822
q5	5251	5223	5239	5223
q6	209	125	125	125
q7	2245	1813	1813	1813
q8	3221	3286	3282	3282
q9	8423	8465	8444	8444
q10	3779	3964	4012	3964
q11	566	459	474	459
q12	763	576	600	576
q13	15771	3072	3135	3072
q14	323	272	267	267
q15	531	505	469	469
q16	498	441	439	439
q17	1779	1762	1762	1762
q18	8363	7859	7546	7546
q19	2495	1684	1668	1668
q20	2056	1814	1882	1814
q21	5122	4988	4935	4935
q22	489	427	427	427
Total cold run time: 71138 ms
Total hot run time: 55284 ms

doris-robot avatar Apr 07 '24 08:04 doris-robot

TPC-DS: Total hot run time: 181269 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5c3196f917b933a2cd6b40925fcea2c658135e0d, data reload: false

query1	899	1124	1106	1106
query2	6309	1998	1885	1885
query3	6678	206	207	206
query4	24568	21404	21389	21389
query5	4176	398	407	398
query6	281	206	179	179
query7	4598	301	295	295
query8	229	167	168	167
query9	8446	2256	2247	2247
query10	451	232	234	232
query11	14948	14396	14508	14396
query12	139	90	84	84
query13	1634	365	366	365
query14	8563	6946	6841	6841
query15	210	178	184	178
query16	6609	268	267	267
query17	984	593	563	563
query18	1788	281	279	279
query19	199	152	155	152
query20	93	85	88	85
query21	207	130	128	128
query22	5001	4830	4781	4781
query23	33536	32943	32519	32519
query24	11776	3198	3139	3139
query25	721	406	414	406
query26	1836	164	160	160
query27	3245	372	382	372
query28	7455	1915	1873	1873
query29	1136	610	612	610
query30	307	175	175	175
query31	1019	732	773	732
query32	107	60	57	57
query33	673	252	240	240
query34	1208	496	509	496
query35	859	711	722	711
query36	1016	868	898	868
query37	242	76	74	74
query38	3585	3623	3569	3569
query39	1630	1590	1576	1576
query40	247	135	128	128
query41	50	46	46	46
query42	118	103	106	103
query43	462	442	436	436
query44	1165	748	742	742
query45	271	265	272	265
query46	1117	829	792	792
query47	1979	1897	1875	1875
query48	377	310	300	300
query49	919	363	362	362
query50	817	412	418	412
query51	6891	6749	6751	6749
query52	106	93	93	93
query53	350	289	292	289
query54	284	229	220	220
query55	90	71	72	71
query56	246	230	251	230
query57	1283	1163	1161	1161
query58	241	235	217	217
query59	2848	2605	2460	2460
query60	253	225	227	225
query61	95	88	85	85
query62	678	434	453	434
query63	308	272	270	270
query64	5887	3137	3159	3137
query65	3015	2998	2984	2984
query66	1333	313	316	313
query67	15686	14883	14745	14745
query68	7389	561	575	561
query69	545	298	288	288
query70	1322	1118	1080	1080
query71	530	266	262	262
query72	6260	2573	2393	2393
query73	800	317	316	316
query74	6793	6315	6371	6315
query75	3594	2330	2296	2296
query76	6072	1213	1216	1213
query77	607	245	245	245
query78	10870	10184	10013	10013
query79	9501	531	530	530
query80	1337	427	434	427
query81	508	234	240	234
query82	639	96	95	95
query83	214	168	181	168
query84	270	86	88	86
query85	1348	289	287	287
query86	442	298	290	290
query87	3680	3451	3480	3451
query88	3528	2272	2277	2272
query89	545	373	367	367
query90	2019	179	176	176
query91	133	101	110	101
query92	58	47	48	47
query93	6572	535	533	533
query94	972	189	183	183
query95	437	319	319	319
query96	615	271	266	266
query97	2679	2487	2490	2487
query98	228	208	217	208
query99	1364	868	816	816
Total cold run time: 296348 ms
Total hot run time: 181269 ms

doris-robot avatar Apr 07 '24 08:04 doris-robot

ClickBench: Total hot run time: 30.13 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5c3196f917b933a2cd6b40925fcea2c658135e0d, data reload: false

query1	0.03	0.03	0.03
query2	0.08	0.04	0.04
query3	0.24	0.05	0.05
query4	1.66	0.06	0.06
query5	0.48	0.48	0.49
query6	1.15	0.66	0.66
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.57	0.49	0.51
query10	0.55	0.57	0.56
query11	0.16	0.12	0.11
query12	0.14	0.12	0.12
query13	0.61	0.60	0.59
query14	0.78	0.79	0.81
query15	0.86	0.83	0.84
query16	0.35	0.36	0.36
query17	0.98	0.96	0.98
query18	0.25	0.25	0.26
query19	1.86	1.74	1.78
query20	0.02	0.01	0.01
query21	15.43	0.65	0.64
query22	4.15	5.97	1.85
query23	17.74	1.31	1.27
query24	1.51	0.20	0.19
query25	0.15	0.09	0.08
query26	0.27	0.16	0.16
query27	0.08	0.07	0.08
query28	13.85	0.96	0.94
query29	12.65	3.30	3.23
query30	0.26	0.06	0.06
query31	2.85	0.38	0.39
query32	3.27	0.47	0.47
query33	2.86	2.87	2.89
query34	15.51	4.35	4.34
query35	4.38	4.34	4.39
query36	0.68	0.47	0.46
query37	0.19	0.16	0.16
query38	0.15	0.14	0.14
query39	0.04	0.03	0.04
query40	0.18	0.15	0.14
query41	0.10	0.05	0.05
query42	0.07	0.06	0.04
query43	0.04	0.04	0.04
Total cold run time: 107.25 s
Total hot run time: 30.13 s

doris-robot avatar Apr 07 '24 08:04 doris-robot

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 5c3196f917b933a2cd6b40925fcea2c658135e0d with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       16.1 seconds inserted 10000000 Rows, about 621K ops/s

doris-robot avatar Apr 07 '24 08:04 doris-robot

TeamCity be ut coverage result: Function Coverage: 35.63% (8887/24943) Line Coverage: 27.34% (72977/266892) Region Coverage: 26.51% (37729/142302) Branch Coverage: 23.33% (19225/82420) Coverage Report: http://coverage.selectdb-in.cc/coverage/5c3196f917b933a2cd6b40925fcea2c658135e0d_5c3196f917b933a2cd6b40925fcea2c658135e0d/report/index.html

doris-robot avatar Apr 07 '24 08:04 doris-robot

run builall

jacktengg avatar Apr 08 '24 03:04 jacktengg

run buildall

jacktengg avatar Apr 09 '24 15:04 jacktengg

TeamCity be ut coverage result: Function Coverage: 35.63% (8904/24990) Line Coverage: 27.36% (73130/267308) Region Coverage: 26.52% (37789/142471) Branch Coverage: 23.33% (19257/82538) Coverage Report: http://coverage.selectdb-in.cc/coverage/bc3113099881a46ebf1fd803527093ebf796e729_bc3113099881a46ebf1fd803527093ebf796e729/report/index.html

doris-robot avatar Apr 09 '24 17:04 doris-robot

run buildall

jacktengg avatar Apr 10 '24 01:04 jacktengg

TeamCity be ut coverage result: Function Coverage: 35.63% (8904/24990) Line Coverage: 27.35% (73115/267307) Region Coverage: 26.52% (37784/142469) Branch Coverage: 23.32% (19248/82536) Coverage Report: http://coverage.selectdb-in.cc/coverage/906ac6a43beaca4a1baf9927d44d6a894100fe0b_906ac6a43beaca4a1baf9927d44d6a894100fe0b/report/index.html

doris-robot avatar Apr 10 '24 02:04 doris-robot

run buildall

jacktengg avatar Apr 10 '24 02:04 jacktengg

run buildall

jacktengg avatar Apr 10 '24 03:04 jacktengg

TeamCity be ut coverage result: Function Coverage: 35.64% (8906/24991) Line Coverage: 27.36% (73151/267347) Region Coverage: 26.53% (37799/142477) Branch Coverage: 23.33% (19260/82538) Coverage Report: http://coverage.selectdb-in.cc/coverage/b9891120ea5534c714d7233406c998d503ea9bbd_b9891120ea5534c714d7233406c998d503ea9bbd/report/index.html

doris-robot avatar Apr 10 '24 03:04 doris-robot

run buildall

jacktengg avatar Apr 10 '24 08:04 jacktengg

TeamCity be ut coverage result: Function Coverage: 35.63% (8890/24953) Line Coverage: 27.35% (73038/267068) Region Coverage: 26.51% (37736/142336) Branch Coverage: 23.32% (19235/82478) Coverage Report: http://coverage.selectdb-in.cc/coverage/e58ac438e59143877c46476836c2fdcd7929c889_e58ac438e59143877c46476836c2fdcd7929c889/report/index.html

doris-robot avatar Apr 10 '24 09:04 doris-robot

run buildall

jacktengg avatar Apr 10 '24 13:04 jacktengg