doris icon indicating copy to clipboard operation
doris copied to clipboard

[Refactor](SerDe) use DataTypeSerDe to serialize column to text

Open Mryange opened this issue 6 months ago • 48 comments

What problem does this PR solve?

Release note

None

Check List (For Author)

  • Test

    • [ ] Regression test
    • [ ] Unit Test
    • [ ] Manual test (add detailed scripts or steps below)
    • [ ] No need to test or manual test. Explain why:
      • [ ] This is a refactor/code format and no logic has been changed.
      • [ ] Previous test can cover this change.
      • [ ] No code files have been changed.
      • [ ] Other reason
  • Behavior changed:

    • [ ] No.
    • [ ] Yes.
  • Does this need documentation?

    • [ ] No.
    • [ ] Yes.

Check List (For Reviewer who merge this PR)

  • [ ] Confirm the release note
  • [ ] Confirm test cases
  • [ ] Confirm document
  • [ ] Add branch pick label

Mryange avatar Jun 04 '25 10:06 Mryange

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

hello-stephen avatar Jun 04 '25 10:06 hello-stephen

run buildall

Mryange avatar Jun 04 '25 10:06 Mryange

run buildall

Mryange avatar Jun 05 '25 00:06 Mryange

run buildall

Mryange avatar Jun 05 '25 03:06 Mryange

run buildall

Mryange avatar Jun 05 '25 10:06 Mryange

TPC-H: Total hot run time: 33720 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b28a51835ab3d456f0553e72836364f5d67d5fbf, data reload: false

------ Round 1 ----------------------------------
q1	26260	5070	4998	4998
q2	1965	281	175	175
q3	10430	1255	675	675
q4	10221	1003	497	497
q5	7651	2329	2371	2329
q6	182	162	131	131
q7	924	740	614	614
q8	9316	1324	1158	1158
q9	6790	5028	5061	5028
q10	6880	2323	1899	1899
q11	490	290	286	286
q12	345	356	208	208
q13	17768	3663	3065	3065
q14	235	234	210	210
q15	571	481	490	481
q16	438	438	375	375
q17	602	858	368	368
q18	7553	7163	7150	7150
q19	2374	1371	557	557
q20	330	331	219	219
q21	3647	3128	2322	2322
q22	1026	1020	975	975
Total cold run time: 115998 ms
Total hot run time: 33720 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5231	5044	5043	5043
q2	231	316	232	232
q3	2100	2627	2259	2259
q4	1344	1782	1336	1336
q5	4499	4380	4428	4380
q6	221	165	129	129
q7	2026	1951	1731	1731
q8	2598	2612	2530	2530
q9	7267	7257	6976	6976
q10	3017	3192	2780	2780
q11	573	522	500	500
q12	679	800	633	633
q13	3540	3883	3196	3196
q14	281	313	291	291
q15	528	475	471	471
q16	461	501	427	427
q17	1136	1603	1329	1329
q18	7728	7603	7469	7469
q19	805	785	830	785
q20	1999	2140	1836	1836
q21	4846	4527	4383	4383
q22	1098	1061	1017	1017
Total cold run time: 52208 ms
Total hot run time: 49733 ms

doris-robot avatar Jun 05 '25 12:06 doris-robot

TPC-DS: Total hot run time: 192673 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b28a51835ab3d456f0553e72836364f5d67d5fbf, data reload: false

query1	1429	1089	1049	1049
query2	6239	1908	1863	1863
query3	10987	4476	4545	4476
query4	53858	26321	23514	23514
query5	4906	585	457	457
query6	382	236	203	203
query7	4909	520	295	295
query8	296	235	215	215
query9	5538	2658	2651	2651
query10	432	334	279	279
query11	15101	15321	14810	14810
query12	157	119	106	106
query13	1046	528	405	405
query14	10191	6392	6309	6309
query15	213	217	214	214
query16	7159	648	508	508
query17	1103	769	571	571
query18	1533	424	314	314
query19	192	189	167	167
query20	137	128	122	122
query21	241	125	108	108
query22	4367	4478	4310	4310
query23	34298	33512	33622	33512
query24	6888	2410	2425	2410
query25	459	467	430	430
query26	711	286	155	155
query27	2274	519	341	341
query28	3049	2203	2156	2156
query29	579	569	424	424
query30	275	215	191	191
query31	831	855	813	813
query32	73	65	66	65
query33	454	368	322	322
query34	778	866	542	542
query35	813	867	753	753
query36	968	1019	916	916
query37	109	114	84	84
query38	4228	4372	4213	4213
query39	1507	1467	1501	1467
query40	221	121	116	116
query41	59	56	55	55
query42	129	110	106	106
query43	526	511	492	492
query44	1322	829	837	829
query45	184	172	174	172
query46	851	1034	663	663
query47	1849	1880	1805	1805
query48	386	425	317	317
query49	680	497	395	395
query50	665	704	415	415
query51	4330	4234	4248	4234
query52	113	114	104	104
query53	225	265	186	186
query54	576	572	518	518
query55	84	86	89	86
query56	303	322	288	288
query57	1147	1205	1128	1128
query58	264	253	252	252
query59	2778	2865	2782	2782
query60	332	327	306	306
query61	126	120	125	120
query62	728	740	666	666
query63	240	194	194	194
query64	1809	1089	702	702
query65	4218	4145	4163	4145
query66	710	407	306	306
query67	16101	15561	15341	15341
query68	7248	881	514	514
query69	546	313	275	275
query70	1213	1124	1129	1124
query71	507	316	306	306
query72	6011	4780	4711	4711
query73	1472	621	353	353
query74	9307	8794	8912	8794
query75	4020	3187	2695	2695
query76	4202	1190	744	744
query77	739	361	340	340
query78	10011	10208	9340	9340
query79	2618	802	585	585
query80	604	512	433	433
query81	490	254	225	225
query82	440	125	95	95
query83	293	256	226	226
query84	296	105	92	92
query85	862	354	324	324
query86	362	298	282	282
query87	4358	4427	4339	4339
query88	3573	2244	2236	2236
query89	406	306	284	284
query90	1850	210	199	199
query91	140	140	111	111
query92	77	61	58	58
query93	1964	922	566	566
query94	673	416	304	304
query95	374	291	290	290
query96	494	572	280	280
query97	2731	2754	2625	2625
query98	232	202	199	199
query99	1431	1404	1261	1261
Total cold run time: 299210 ms
Total hot run time: 192673 ms

doris-robot avatar Jun 05 '25 13:06 doris-robot

ClickBench: Total hot run time: 29.37 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b28a51835ab3d456f0553e72836364f5d67d5fbf, data reload: false

query1	0.05	0.04	0.03
query2	0.11	0.11	0.12
query3	0.26	0.19	0.20
query4	1.59	0.20	0.19
query5	0.44	0.46	0.44
query6	1.15	0.68	0.66
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.60	0.52	0.51
query10	0.57	0.59	0.57
query11	0.15	0.11	0.11
query12	0.15	0.11	0.12
query13	0.62	0.59	0.60
query14	0.80	0.82	0.78
query15	0.88	0.85	0.88
query16	0.39	0.37	0.39
query17	1.04	1.01	1.02
query18	0.22	0.20	0.20
query19	1.89	1.90	1.79
query20	0.01	0.01	0.01
query21	15.40	0.91	0.55
query22	0.75	1.34	0.81
query23	14.72	1.38	0.60
query24	7.40	1.54	0.92
query25	0.47	0.25	0.15
query26	0.56	0.17	0.13
query27	0.05	0.05	0.05
query28	9.32	0.92	0.44
query29	12.65	4.05	3.35
query30	0.25	0.09	0.06
query31	2.82	0.60	0.39
query32	3.23	0.54	0.48
query33	2.98	3.09	3.10
query34	15.79	5.09	4.48
query35	4.54	4.50	4.50
query36	0.66	0.51	0.48
query37	0.09	0.06	0.07
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.16	0.13	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.07 s
Total hot run time: 29.37 s

doris-robot avatar Jun 05 '25 13:06 doris-robot

run beut

Mryange avatar Jun 05 '25 15:06 Mryange

run buildall

Mryange avatar Jun 06 '25 14:06 Mryange

TPC-H: Total hot run time: 33963 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit aef7fc50e35587ee4abfa3913d5f0ca4567e0e04, data reload: false

------ Round 1 ----------------------------------
q1	26539	5636	5124	5124
q2	1962	303	191	191
q3	10413	1285	722	722
q4	10241	995	524	524
q5	7683	2414	2289	2289
q6	182	166	133	133
q7	891	728	612	612
q8	9326	1305	1144	1144
q9	6833	5124	5091	5091
q10	6877	2321	1891	1891
q11	490	317	279	279
q12	352	362	216	216
q13	17761	3678	3108	3108
q14	238	230	208	208
q15	566	482	493	482
q16	438	435	369	369
q17	620	865	388	388
q18	7820	7290	7011	7011
q19	1525	969	586	586
q20	350	339	223	223
q21	3841	3208	2404	2404
q22	1029	1031	968	968
Total cold run time: 115977 ms
Total hot run time: 33963 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5486	5052	5091	5052
q2	247	315	225	225
q3	2171	2614	2304	2304
q4	1375	1856	1552	1552
q5	4536	4424	4360	4360
q6	210	169	123	123
q7	2037	1956	1779	1779
q8	2576	2595	2524	2524
q9	7158	7164	7173	7164
q10	2980	3182	2732	2732
q11	589	522	495	495
q12	699	782	616	616
q13	3532	3908	3248	3248
q14	276	303	266	266
q15	531	481	477	477
q16	442	491	450	450
q17	1163	1615	1323	1323
q18	7679	7540	7437	7437
q19	809	868	962	868
q20	1992	2094	1855	1855
q21	4749	4350	4357	4350
q22	1055	1016	976	976
Total cold run time: 52292 ms
Total hot run time: 50176 ms

doris-robot avatar Jun 06 '25 16:06 doris-robot

TPC-DS: Total hot run time: 186047 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit aef7fc50e35587ee4abfa3913d5f0ca4567e0e04, data reload: false

query1	1016	481	502	481
query2	6608	1861	1787	1787
query3	6756	224	217	217
query4	26072	23581	23264	23264
query5	4354	604	444	444
query6	321	196	198	196
query7	4616	496	296	296
query8	253	221	206	206
query9	8609	2626	2616	2616
query10	498	347	279	279
query11	15931	15055	15221	15055
query12	160	107	107	107
query13	1655	532	401	401
query14	8853	6152	6171	6152
query15	203	197	174	174
query16	7164	655	513	513
query17	1209	721	574	574
query18	1971	417	304	304
query19	200	191	179	179
query20	125	118	118	118
query21	217	122	118	118
query22	4000	4122	4113	4113
query23	34145	32997	33029	32997
query24	8536	2410	2372	2372
query25	527	469	393	393
query26	1231	271	148	148
query27	2739	499	341	341
query28	4355	2145	2120	2120
query29	777	571	428	428
query30	284	221	184	184
query31	916	842	758	758
query32	76	66	64	64
query33	550	383	335	335
query34	790	850	542	542
query35	774	813	725	725
query36	934	998	862	862
query37	115	101	77	77
query38	4189	4119	4030	4030
query39	1506	1378	1411	1378
query40	217	119	104	104
query41	63	60	59	59
query42	134	107	104	104
query43	486	501	469	469
query44	1325	836	831	831
query45	192	181	175	175
query46	848	1026	612	612
query47	1791	1829	1717	1717
query48	400	414	310	310
query49	737	498	396	396
query50	656	669	392	392
query51	4157	4088	4156	4088
query52	114	106	101	101
query53	228	250	185	185
query54	579	593	499	499
query55	87	85	80	80
query56	324	306	274	274
query57	1156	1145	1071	1071
query58	265	260	248	248
query59	2694	2643	2576	2576
query60	327	317	307	307
query61	136	126	121	121
query62	822	736	656	656
query63	226	182	188	182
query64	4348	1033	680	680
query65	4229	4138	4138	4138
query66	1157	423	328	328
query67	15711	15672	15379	15379
query68	8321	903	521	521
query69	479	312	273	273
query70	1210	1071	1121	1071
query71	471	326	309	309
query72	5377	4710	4815	4710
query73	735	641	352	352
query74	9137	9164	9172	9164
query75	3830	3200	2703	2703
query76	3648	1182	732	732
query77	783	370	282	282
query78	10026	10250	9289	9289
query79	2137	842	576	576
query80	589	524	529	524
query81	485	262	217	217
query82	465	125	99	99
query83	255	246	240	240
query84	252	104	95	95
query85	779	366	318	318
query86	394	297	278	278
query87	4386	4459	4331	4331
query88	3655	2307	2291	2291
query89	390	322	280	280
query90	1880	214	218	214
query91	154	141	111	111
query92	76	62	63	62
query93	1601	981	581	581
query94	669	417	312	312
query95	370	287	297	287
query96	499	573	282	282
query97	2737	2713	2639	2639
query98	236	211	201	201
query99	1423	1397	1273	1273
Total cold run time: 274093 ms
Total hot run time: 186047 ms

doris-robot avatar Jun 06 '25 16:06 doris-robot

ClickBench: Total hot run time: 28.86 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit aef7fc50e35587ee4abfa3913d5f0ca4567e0e04, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.11	0.10
query3	0.25	0.19	0.20
query4	1.59	0.19	0.12
query5	0.43	0.41	0.43
query6	1.15	0.65	0.66
query7	0.03	0.01	0.01
query8	0.04	0.04	0.03
query9	0.58	0.51	0.51
query10	0.58	0.57	0.57
query11	0.16	0.10	0.10
query12	0.15	0.11	0.11
query13	0.61	0.60	0.59
query14	0.80	0.82	0.81
query15	0.88	0.86	0.85
query16	0.39	0.38	0.37
query17	0.99	1.06	1.06
query18	0.22	0.21	0.20
query19	1.88	1.79	1.79
query20	0.01	0.01	0.02
query21	15.40	0.89	0.57
query22	0.77	1.22	0.65
query23	14.96	1.35	0.63
query24	7.21	1.22	0.78
query25	0.54	0.12	0.17
query26	0.60	0.16	0.14
query27	0.05	0.05	0.05
query28	8.99	0.89	0.44
query29	12.60	3.98	3.26
query30	0.26	0.10	0.06
query31	2.82	0.59	0.38
query32	3.23	0.54	0.46
query33	3.15	3.08	3.08
query34	15.64	5.08	4.46
query35	4.48	4.55	4.47
query36	0.67	0.51	0.47
query37	0.09	0.07	0.06
query38	0.05	0.04	0.04
query39	0.04	0.03	0.02
query40	0.17	0.14	0.14
query41	0.08	0.03	0.02
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 102.77 s
Total hot run time: 28.86 s

doris-robot avatar Jun 06 '25 16:06 doris-robot

run beut

Mryange avatar Jun 07 '25 15:06 Mryange

run beut

Mryange avatar Jun 08 '25 02:06 Mryange

BE UT Coverage Report

Increment line coverage 15.97% (46/288) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 56.33% (15070/26752)
Line Coverage 45.12% (134665/298461)
Region Coverage 44.24% (67775/153200)
Branch Coverage 38.80% (34745/89538)

hello-stephen avatar Jun 08 '25 04:06 hello-stephen

BE Regression && UT Coverage Report

Increment line coverage 63.89% (184/288) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 79.55% (20947/26331)
Line Coverage 72.68% (216804/298311)
Region Coverage 70.83% (127636/180202)
Branch Coverage 64.54% (66065/102368)

hello-stephen avatar Jun 08 '25 04:06 hello-stephen

run buildall

Mryange avatar Jun 09 '25 08:06 Mryange

TPC-H: Total hot run time: 33693 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f56048818377f7fc4bfb015a546376880dc2e9a1, data reload: false

------ Round 1 ----------------------------------
q1	26281	5001	4970	4970
q2	1960	288	183	183
q3	10402	1249	725	725
q4	10249	1017	513	513
q5	7671	2407	2285	2285
q6	183	163	129	129
q7	875	744	614	614
q8	9310	1343	1041	1041
q9	6715	5108	5076	5076
q10	6845	2319	1892	1892
q11	505	288	282	282
q12	343	350	220	220
q13	17759	3678	3063	3063
q14	227	222	212	212
q15	551	501	509	501
q16	426	430	369	369
q17	606	862	368	368
q18	8067	7146	7127	7127
q19	1921	965	565	565
q20	327	352	229	229
q21	3796	3154	2362	2362
q22	1048	998	967	967
Total cold run time: 116067 ms
Total hot run time: 33693 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5156	5054	5059	5054
q2	242	317	221	221
q3	2219	2680	2310	2310
q4	1364	1827	1429	1429
q5	4579	4419	4398	4398
q6	216	170	127	127
q7	2009	1920	1706	1706
q8	2642	2556	2545	2545
q9	7115	7097	7129	7097
q10	2982	3209	2786	2786
q11	582	504	501	501
q12	685	753	643	643
q13	3388	3831	3228	3228
q14	276	319	270	270
q15	544	505	506	505
q16	434	491	435	435
q17	1149	1627	1395	1395
q18	7801	7585	7492	7492
q19	815	832	869	832
q20	1944	2060	1925	1925
q21	4863	4249	4334	4249
q22	1076	1026	961	961
Total cold run time: 52081 ms
Total hot run time: 50109 ms

doris-robot avatar Jun 09 '25 10:06 doris-robot

BE UT Coverage Report

Increment line coverage 16.84% (49/291) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 56.33% (15071/26753)
Line Coverage 45.12% (134680/298477)
Region Coverage 44.23% (67762/153215)
Branch Coverage 38.81% (34749/89542)

doris-robot avatar Jun 09 '25 10:06 doris-robot

TPC-DS: Total hot run time: 185795 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f56048818377f7fc4bfb015a546376880dc2e9a1, data reload: false

query1	999	471	489	471
query2	6560	1844	1850	1844
query3	6760	229	216	216
query4	26307	23852	23073	23073
query5	4395	612	479	479
query6	311	202	198	198
query7	4641	493	282	282
query8	264	228	218	218
query9	8624	2630	2625	2625
query10	506	363	275	275
query11	15861	15260	15195	15195
query12	153	109	105	105
query13	1660	501	407	407
query14	9285	6036	6108	6036
query15	203	183	160	160
query16	7227	641	502	502
query17	1167	696	552	552
query18	1963	420	300	300
query19	185	182	153	153
query20	120	118	121	118
query21	221	122	138	122
query22	4031	4022	3988	3988
query23	34110	33167	33103	33103
query24	8402	2352	2357	2352
query25	536	466	398	398
query26	1234	269	151	151
query27	2751	505	346	346
query28	4354	2132	2112	2112
query29	779	544	435	435
query30	281	219	188	188
query31	950	828	766	766
query32	72	66	62	62
query33	553	358	319	319
query34	798	859	530	530
query35	768	799	727	727
query36	963	975	878	878
query37	110	109	77	77
query38	4094	4191	4098	4098
query39	1488	1423	1405	1405
query40	212	124	114	114
query41	68	65	75	65
query42	134	112	116	112
query43	510	516	492	492
query44	1302	825	830	825
query45	184	175	170	170
query46	831	1023	631	631
query47	1782	1819	1744	1744
query48	388	440	333	333
query49	771	519	388	388
query50	645	666	393	393
query51	4087	4130	4045	4045
query52	112	112	100	100
query53	221	247	176	176
query54	574	561	491	491
query55	82	86	84	84
query56	308	321	301	301
query57	1170	1207	1124	1124
query58	262	256	256	256
query59	2629	2741	2548	2548
query60	340	311	306	306
query61	122	121	124	121
query62	820	723	639	639
query63	223	184	183	183
query64	4345	999	669	669
query65	4253	4114	4189	4114
query66	1168	400	311	311
query67	16000	15382	15635	15382
query68	7817	872	533	533
query69	462	304	262	262
query70	1193	1126	1147	1126
query71	431	326	302	302
query72	5715	4625	4577	4577
query73	619	566	350	350
query74	8785	9246	8998	8998
query75	3735	3209	2694	2694
query76	3439	1275	830	830
query77	791	378	301	301
query78	9941	10195	9255	9255
query79	2690	810	583	583
query80	660	524	461	461
query81	503	257	229	229
query82	474	127	98	98
query83	257	250	236	236
query84	256	120	92	92
query85	825	349	322	322
query86	390	274	289	274
query87	4461	4363	4290	4290
query88	3802	2317	2320	2317
query89	380	319	288	288
query90	1887	218	216	216
query91	142	139	113	113
query92	76	61	60	60
query93	2226	952	588	588
query94	678	410	309	309
query95	375	297	288	288
query96	495	589	286	286
query97	2669	2735	2665	2665
query98	239	217	205	205
query99	1392	1451	1264	1264
Total cold run time: 275034 ms
Total hot run time: 185795 ms

doris-robot avatar Jun 09 '25 10:06 doris-robot

ClickBench: Total hot run time: 29.12 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f56048818377f7fc4bfb015a546376880dc2e9a1, data reload: false

query1	0.03	0.04	0.03
query2	0.12	0.10	0.12
query3	0.25	0.20	0.19
query4	1.59	0.20	0.20
query5	0.47	0.44	0.44
query6	1.18	0.66	0.66
query7	0.02	0.02	0.02
query8	0.04	0.04	0.04
query9	0.58	0.55	0.51
query10	0.57	0.58	0.58
query11	0.16	0.11	0.11
query12	0.14	0.12	0.12
query13	0.61	0.59	0.61
query14	0.80	0.81	0.80
query15	0.87	0.86	0.87
query16	0.38	0.37	0.38
query17	1.04	1.08	1.03
query18	0.23	0.21	0.21
query19	1.91	1.88	1.82
query20	0.02	0.01	0.01
query21	15.39	0.88	0.54
query22	0.76	1.23	0.68
query23	14.86	1.35	0.64
query24	7.65	0.90	0.96
query25	0.41	0.16	0.05
query26	0.62	0.17	0.14
query27	0.05	0.04	0.05
query28	9.14	0.88	0.42
query29	12.56	4.03	3.34
query30	0.26	0.10	0.06
query31	2.81	0.62	0.39
query32	3.23	0.55	0.47
query33	3.00	3.03	3.04
query34	15.88	5.09	4.43
query35	4.50	4.55	4.50
query36	0.68	0.50	0.48
query37	0.08	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.18	0.15	0.13
query41	0.08	0.03	0.02
query42	0.04	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 103.3 s
Total hot run time: 29.12 s

doris-robot avatar Jun 09 '25 10:06 doris-robot

BE Regression && UT Coverage Report

Increment line coverage 64.26% (187/291) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 79.72% (20992/26332)
Line Coverage 72.69% (216861/298331)
Region Coverage 70.89% (127777/180240)
Branch Coverage 64.60% (66126/102366)

hello-stephen avatar Jun 09 '25 14:06 hello-stephen

run buildall

Mryange avatar Jun 10 '25 08:06 Mryange

TPC-H: Total hot run time: 33809 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 29372635c193fff8a7d7ae8d87c9ce9ecb697e04, data reload: false

------ Round 1 ----------------------------------
q1	26476	5107	4999	4999
q2	1957	282	188	188
q3	10383	1266	682	682
q4	10222	990	540	540
q5	7571	2360	2337	2337
q6	185	159	131	131
q7	884	717	636	636
q8	9313	1240	1078	1078
q9	6709	5098	5089	5089
q10	6868	2321	1892	1892
q11	491	285	277	277
q12	344	344	220	220
q13	17782	3733	3134	3134
q14	239	226	205	205
q15	575	479	480	479
q16	430	425	371	371
q17	599	862	358	358
q18	7752	7181	7142	7142
q19	1900	969	561	561
q20	344	340	218	218
q21	3688	2559	2290	2290
q22	1051	1022	982	982
Total cold run time: 115763 ms
Total hot run time: 33809 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5184	5072	5064	5064
q2	237	314	223	223
q3	2165	2647	2281	2281
q4	1412	1792	1374	1374
q5	4443	4376	4431	4376
q6	222	169	132	132
q7	2061	1932	1750	1750
q8	2599	2563	2502	2502
q9	7155	7152	6982	6982
q10	2933	3195	2773	2773
q11	605	512	502	502
q12	701	780	661	661
q13	3479	3909	3334	3334
q14	289	323	265	265
q15	539	485	473	473
q16	442	475	464	464
q17	1157	1543	1354	1354
q18	7856	7661	7424	7424
q19	784	828	862	828
q20	2008	2088	1978	1978
q21	4798	4366	4386	4366
q22	1082	1096	1022	1022
Total cold run time: 52151 ms
Total hot run time: 50128 ms

doris-robot avatar Jun 10 '25 10:06 doris-robot

TPC-DS: Total hot run time: 192303 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 29372635c193fff8a7d7ae8d87c9ce9ecb697e04, data reload: false

query1	1418	1086	1065	1065
query2	6257	1910	1897	1897
query3	11174	4764	4635	4635
query4	25164	23854	22916	22916
query5	4980	650	495	495
query6	315	209	208	208
query7	3999	528	285	285
query8	279	221	214	214
query9	8511	2642	2617	2617
query10	498	336	280	280
query11	16047	15074	14743	14743
query12	157	111	104	104
query13	1549	509	406	406
query14	9251	6225	6137	6137
query15	196	190	188	188
query16	7608	637	489	489
query17	1128	730	619	619
query18	2028	448	317	317
query19	198	196	180	180
query20	132	123	124	123
query21	210	126	106	106
query22	4404	4435	4378	4378
query23	34524	33782	33598	33598
query24	8372	2398	2423	2398
query25	508	458	404	404
query26	730	274	156	156
query27	2851	514	343	343
query28	4601	2237	2153	2153
query29	631	572	437	437
query30	299	235	192	192
query31	898	865	789	789
query32	71	64	66	64
query33	532	373	331	331
query34	815	879	554	554
query35	842	839	772	772
query36	982	986	922	922
query37	112	100	81	81
query38	4222	4284	4175	4175
query39	1521	1440	1495	1440
query40	211	122	109	109
query41	63	60	61	60
query42	132	118	112	112
query43	531	524	484	484
query44	1348	856	839	839
query45	182	179	177	177
query46	843	1031	645	645
query47	1812	1882	1786	1786
query48	396	434	324	324
query49	685	518	436	436
query50	682	686	416	416
query51	4289	4298	4242	4242
query52	116	113	101	101
query53	229	259	191	191
query54	591	601	528	528
query55	94	91	91	91
query56	335	331	313	313
query57	1218	1252	1165	1165
query58	283	282	278	278
query59	2763	2788	2683	2683
query60	339	360	325	325
query61	152	153	148	148
query62	813	745	670	670
query63	221	190	195	190
query64	3013	1046	700	700
query65	4339	4233	4302	4233
query66	801	486	320	320
query67	16124	15479	15367	15367
query68	9131	893	525	525
query69	493	312	266	266
query70	1179	1095	1059	1059
query71	473	325	299	299
query72	5732	4639	4705	4639
query73	703	572	349	349
query74	9219	8902	8751	8751
query75	4275	3198	2702	2702
query76	3717	1196	756	756
query77	786	373	278	278
query78	10105	10259	9438	9438
query79	2040	781	572	572
query80	581	501	432	432
query81	493	260	218	218
query82	485	123	91	91
query83	255	252	230	230
query84	250	103	80	80
query85	783	339	311	311
query86	382	304	293	293
query87	4386	4454	4368	4368
query88	3639	2265	2246	2246
query89	399	314	284	284
query90	1850	207	207	207
query91	144	147	113	113
query92	75	64	55	55
query93	1678	933	582	582
query94	656	421	308	308
query95	379	292	282	282
query96	492	553	279	279
query97	2746	2733	2637	2637
query98	232	218	230	218
query99	1436	1410	1291	1291
Total cold run time: 279813 ms
Total hot run time: 192303 ms

doris-robot avatar Jun 10 '25 10:06 doris-robot

ClickBench: Total hot run time: 29.13 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 29372635c193fff8a7d7ae8d87c9ce9ecb697e04, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.11	0.10
query3	0.26	0.20	0.20
query4	1.59	0.20	0.21
query5	0.44	0.41	0.44
query6	1.16	0.66	0.68
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.58	0.51	0.51
query10	0.56	0.59	0.57
query11	0.16	0.11	0.10
query12	0.15	0.12	0.11
query13	0.61	0.60	0.60
query14	0.83	0.85	0.82
query15	0.87	0.86	0.85
query16	0.37	0.37	0.37
query17	1.03	1.04	1.00
query18	0.22	0.21	0.20
query19	1.93	1.84	1.80
query20	0.01	0.02	0.02
query21	15.41	0.88	0.56
query22	0.75	1.14	0.74
query23	14.84	1.39	0.68
query24	6.73	2.40	0.62
query25	0.51	0.19	0.13
query26	0.52	0.17	0.15
query27	0.06	0.05	0.04
query28	9.63	0.86	0.45
query29	12.96	4.02	3.35
query30	0.25	0.09	0.06
query31	2.84	0.61	0.39
query32	3.24	0.56	0.48
query33	2.99	3.06	3.09
query34	15.83	5.17	4.52
query35	4.56	4.53	4.50
query36	0.66	0.50	0.49
query37	0.09	0.07	0.06
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.17	0.14	0.14
query41	0.08	0.02	0.02
query42	0.03	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 103.26 s
Total hot run time: 29.13 s

doris-robot avatar Jun 10 '25 11:06 doris-robot

run beut

Mryange avatar Jun 10 '25 16:06 Mryange

BE UT Coverage Report

Increment line coverage 63.92% (186/291) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 56.41% (15098/26767)
Line Coverage 45.16% (134847/298595)
Region Coverage 44.25% (67820/153269)
Branch Coverage 38.80% (34763/89594)

hello-stephen avatar Jun 10 '25 18:06 hello-stephen

BE Regression && UT Coverage Report

Increment line coverage 81.10% (236/291) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 79.71% (20999/26345)
Line Coverage 72.69% (216917/298426)
Region Coverage 70.87% (127780/180302)
Branch Coverage 64.58% (66150/102424)

hello-stephen avatar Jun 11 '25 04:06 hello-stephen