doris icon indicating copy to clipboard operation
doris copied to clipboard

[Function](exec) Add Regex_Count function

Open dwdwqfwe opened this issue 7 months ago • 81 comments

What problem does this PR solve?

Issue Number: close #51350

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • [ ] Regression test
    • [ ] Unit Test
    • [ ] Manual test (add detailed scripts or steps below)
    • [ ] No need to test or manual test. Explain why:
      • [ ] This is a refactor/code format and no logic has been changed.
      • [ ] Previous test can cover this change.
      • [ ] No code files have been changed.
      • [ ] Other reason
  • Behavior changed:

    • [ ] No.
    • [ ] Yes.
  • Does this need documentation?

    • [ ] No.
    • [ ] Yes.

Check List (For Reviewer who merge this PR)

  • [ ] Confirm the release note
  • [ ] Confirm test cases
  • [ ] Confirm document
  • [ ] Add branch pick label

dwdwqfwe avatar Jun 11 '25 15:06 dwdwqfwe

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

hello-stephen avatar Jun 11 '25 15:06 hello-stephen

run buildall

dwdwqfwe avatar Jun 11 '25 15:06 dwdwqfwe

TPC-H: Total hot run time: 34366 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 48664c381489932e922df5f1cb1558a73080139e, data reload: false

------ Round 1 ----------------------------------
q1	26271	5052	4947	4947
q2	1942	271	178	178
q3	10756	1271	675	675
q4	10221	992	533	533
q5	7540	2385	2272	2272
q6	182	161	132	132
q7	916	726	612	612
q8	9304	1280	1075	1075
q9	6935	5106	5073	5073
q10	6886	2309	1924	1924
q11	487	280	261	261
q12	336	343	226	226
q13	17768	3657	3069	3069
q14	234	234	222	222
q15	552	497	486	486
q16	430	430	377	377
q17	601	846	369	369
q18	7613	7113	7165	7113
q19	1416	965	591	591
q20	367	350	237	237
q21	4265	3845	3015	3015
q22	1098	1029	979	979
Total cold run time: 116120 ms
Total hot run time: 34366 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5090	5055	5058	5055
q2	237	314	236	236
q3	2170	2638	2254	2254
q4	1385	1802	1487	1487
q5	4434	4409	4454	4409
q6	221	174	129	129
q7	2031	1948	1770	1770
q8	2616	2495	2501	2495
q9	7331	7250	7173	7173
q10	3005	3220	2774	2774
q11	597	529	500	500
q12	671	800	600	600
q13	3552	3982	3340	3340
q14	299	317	287	287
q15	517	487	484	484
q16	457	484	444	444
q17	1186	1591	1373	1373
q18	7670	7595	7545	7545
q19	886	941	1041	941
q20	2062	1995	1881	1881
q21	4923	4575	4471	4471
q22	1094	1069	1039	1039
Total cold run time: 52434 ms
Total hot run time: 50687 ms

doris-robot avatar Jun 11 '25 16:06 doris-robot

TPC-DS: Total hot run time: 196036 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 48664c381489932e922df5f1cb1558a73080139e, data reload: false

query1	1431	1106	1074	1074
query2	6107	1916	1901	1901
query3	11034	4584	4588	4584
query4	54165	26033	23362	23362
query5	5118	616	457	457
query6	354	223	201	201
query7	4897	543	314	314
query8	296	243	223	223
query9	5669	2936	2911	2911
query10	475	356	282	282
query11	15149	15168	14904	14904
query12	163	107	115	107
query13	1029	560	407	407
query14	10397	6433	6447	6433
query15	209	195	180	180
query16	7116	685	514	514
query17	1082	796	593	593
query18	1543	435	319	319
query19	207	200	170	170
query20	132	125	120	120
query21	211	127	106	106
query22	4614	4511	4519	4511
query23	34567	33689	33692	33689
query24	7012	2512	2513	2512
query25	501	515	450	450
query26	696	287	166	166
query27	2220	546	376	376
query28	2868	2355	2369	2355
query29	637	607	480	480
query30	285	228	205	205
query31	868	896	813	813
query32	78	69	64	64
query33	460	436	335	335
query34	863	905	570	570
query35	806	830	813	813
query36	994	1025	930	930
query37	124	109	86	86
query38	4276	4330	4211	4211
query39	1557	1455	1499	1455
query40	225	140	115	115
query41	65	60	61	60
query42	139	127	125	125
query43	562	556	512	512
query44	1439	922	904	904
query45	182	182	168	168
query46	891	1076	698	698
query47	1882	1903	1813	1813
query48	425	465	332	332
query49	700	497	419	419
query50	722	736	424	424
query51	4242	4256	4246	4246
query52	122	121	117	117
query53	258	283	196	196
query54	637	625	543	543
query55	107	90	90	90
query56	329	326	324	324
query57	1225	1265	1200	1200
query58	290	290	264	264
query59	2724	2841	2751	2751
query60	355	353	360	353
query61	130	127	130	127
query62	743	730	703	703
query63	253	211	200	200
query64	1514	1071	723	723
query65	4314	4153	4177	4153
query66	789	405	316	316
query67	16328	15997	15715	15715
query68	6686	936	571	571
query69	557	311	285	285
query70	1254	1145	1079	1079
query71	517	340	320	320
query72	5928	4743	4860	4743
query73	1458	649	378	378
query74	9204	9240	9057	9057
query75	4079	3230	2707	2707
query76	4255	1234	778	778
query77	746	451	289	289
query78	10113	10301	9392	9392
query79	2599	843	612	612
query80	629	546	468	468
query81	507	263	225	225
query82	433	131	100	100
query83	322	266	245	245
query84	297	104	88	88
query85	771	381	329	329
query86	364	315	309	309
query87	4454	4489	4460	4460
query88	3654	2446	2397	2397
query89	409	328	289	289
query90	1811	210	219	210
query91	150	147	115	115
query92	71	60	62	60
query93	2033	994	606	606
query94	676	460	308	308
query95	386	310	309	309
query96	536	591	294	294
query97	2767	2782	2710	2710
query98	246	216	214	214
query99	1455	1400	1315	1315
Total cold run time: 301169 ms
Total hot run time: 196036 ms

doris-robot avatar Jun 11 '25 16:06 doris-robot

ClickBench: Total hot run time: 29.6 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 48664c381489932e922df5f1cb1558a73080139e, data reload: false

query1	0.05	0.04	0.03
query2	0.13	0.12	0.11
query3	0.26	0.20	0.19
query4	1.59	0.20	0.12
query5	0.43	0.41	0.42
query6	1.17	0.67	0.67
query7	0.02	0.02	0.02
query8	0.05	0.03	0.04
query9	0.60	0.52	0.52
query10	0.57	0.60	0.59
query11	0.16	0.11	0.11
query12	0.15	0.12	0.12
query13	0.62	0.60	0.60
query14	0.79	0.82	0.81
query15	0.89	0.87	0.88
query16	0.38	0.38	0.38
query17	1.07	1.07	1.02
query18	0.24	0.22	0.21
query19	1.95	1.86	1.97
query20	0.01	0.01	0.01
query21	15.40	0.96	0.58
query22	0.76	1.13	0.67
query23	14.97	1.39	0.65
query24	7.00	0.96	0.89
query25	0.47	0.13	0.09
query26	0.49	0.17	0.15
query27	0.06	0.06	0.06
query28	10.21	1.02	0.47
query29	12.87	4.21	3.54
query30	0.26	0.10	0.07
query31	2.82	0.61	0.39
query32	3.25	0.56	0.48
query33	3.05	3.09	3.11
query34	15.82	5.13	4.47
query35	4.52	4.53	4.51
query36	0.68	0.50	0.49
query37	0.10	0.07	0.07
query38	0.06	0.04	0.03
query39	0.03	0.03	0.03
query40	0.17	0.14	0.12
query41	0.08	0.03	0.02
query42	0.04	0.03	0.03
query43	0.05	0.04	0.02
Total cold run time: 104.29 s
Total hot run time: 29.6 s

doris-robot avatar Jun 11 '25 16:06 doris-robot

BE UT Coverage Report

Increment line coverage 3.41% (3/88) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 56.48% (15102/26737)
Line Coverage 45.21% (134900/298379)
Region Coverage 44.31% (67885/153202)
Branch Coverage 38.87% (34823/89588)

doris-robot avatar Jun 11 '25 17:06 doris-robot

BE Regression && UT Coverage Report

Increment line coverage 3.41% (3/88) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 79.75% (20987/26315)
Line Coverage 72.70% (216820/298229)
Region Coverage 70.94% (127838/180198)
Branch Coverage 64.58% (66133/102404)

hello-stephen avatar Jun 11 '25 18:06 hello-stephen

i will pr a new version latter

dwdwqfwe avatar Jun 13 '25 07:06 dwdwqfwe

run buildall

dwdwqfwe avatar Jun 13 '25 12:06 dwdwqfwe

TPC-H: Total hot run time: 34592 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b3030416106a14b8b502b9ddd3a861ddd6f9c5f3, data reload: false

------ Round 1 ----------------------------------
q1	17589	5192	5035	5035
q2	1932	287	178	178
q3	10301	1234	777	777
q4	10220	1015	521	521
q5	7544	2366	2362	2362
q6	189	167	134	134
q7	904	748	618	618
q8	9310	1298	1132	1132
q9	6766	5076	5141	5076
q10	6880	2333	1886	1886
q11	487	296	288	288
q12	349	357	222	222
q13	17830	3649	3971	3649
q14	245	244	228	228
q15	572	487	497	487
q16	447	439	393	393
q17	625	868	382	382
q18	7629	7194	7024	7024
q19	1458	947	564	564
q20	356	347	226	226
q21	3782	3298	2423	2423
q22	1072	1009	987	987
Total cold run time: 106487 ms
Total hot run time: 34592 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5057	5082	5060	5060
q2	240	317	224	224
q3	2126	2672	2288	2288
q4	1400	1823	1400	1400
q5	4228	4134	4377	4134
q6	211	176	131	131
q7	2022	1944	1765	1765
q8	2588	2519	2510	2510
q9	7250	7228	7295	7228
q10	3023	3171	2722	2722
q11	579	516	520	516
q12	692	784	644	644
q13	3469	3862	3308	3308
q14	281	301	282	282
q15	527	476	481	476
q16	445	484	456	456
q17	1135	1519	1368	1368
q18	7879	7520	7421	7421
q19	816	863	953	863
q20	1981	2057	1876	1876
q21	5072	4314	4384	4314
q22	1147	1037	1058	1037
Total cold run time: 52168 ms
Total hot run time: 50023 ms

doris-robot avatar Jun 13 '25 12:06 doris-robot

TPC-DS: Total hot run time: 193478 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b3030416106a14b8b502b9ddd3a861ddd6f9c5f3, data reload: false

query1	1452	1017	1021	1017
query2	6374	1828	1786	1786
query3	11160	4714	4647	4647
query4	25569	23790	23251	23251
query5	4310	638	495	495
query6	318	212	208	208
query7	4000	508	294	294
query8	269	236	226	226
query9	8487	2630	2658	2630
query10	506	360	283	283
query11	15984	14981	14750	14750
query12	166	110	106	106
query13	1562	546	437	437
query14	9597	6292	6189	6189
query15	221	199	167	167
query16	7603	627	504	504
query17	1175	741	623	623
query18	2058	429	311	311
query19	201	199	162	162
query20	133	123	121	121
query21	218	131	119	119
query22	4267	4521	4293	4293
query23	34706	33873	33888	33873
query24	8463	2439	2443	2439
query25	521	455	420	420
query26	1219	287	155	155
query27	2891	515	350	350
query28	4742	2170	2169	2169
query29	725	572	446	446
query30	271	217	197	197
query31	940	862	768	768
query32	75	72	63	63
query33	576	373	304	304
query34	853	899	536	536
query35	829	850	765	765
query36	986	1027	880	880
query37	113	97	77	77
query38	4317	4357	4238	4238
query39	1521	1486	1460	1460
query40	228	127	115	115
query41	66	65	61	61
query42	122	108	119	108
query43	523	501	483	483
query44	1371	864	843	843
query45	194	181	171	171
query46	873	1029	664	664
query47	1827	1843	1808	1808
query48	384	438	321	321
query49	746	489	415	415
query50	684	694	427	427
query51	4232	4368	4246	4246
query52	111	112	105	105
query53	237	268	198	198
query54	606	580	532	532
query55	90	88	87	87
query56	332	319	324	319
query57	1231	1267	1178	1178
query58	289	278	261	261
query59	2675	2710	2651	2651
query60	357	350	326	326
query61	152	146	153	146
query62	792	741	670	670
query63	237	200	199	199
query64	4264	1055	685	685
query65	4428	4340	4264	4264
query66	965	415	321	321
query67	16435	15709	15349	15349
query68	8707	937	542	542
query69	486	322	282	282
query70	1241	1123	1179	1123
query71	461	328	298	298
query72	5619	4785	4789	4785
query73	728	618	364	364
query74	8918	9050	8946	8946
query75	3960	3212	2694	2694
query76	3725	1206	783	783
query77	798	391	288	288
query78	10210	10067	9378	9378
query79	2900	819	582	582
query80	658	491	441	441
query81	515	256	222	222
query82	472	126	93	93
query83	279	246	234	234
query84	294	110	173	110
query85	786	366	311	311
query86	382	314	295	295
query87	4495	4433	4354	4354
query88	3677	2317	2265	2265
query89	422	312	283	283
query90	1840	218	214	214
query91	142	144	118	118
query92	78	60	59	59
query93	2728	983	591	591
query94	664	411	315	315
query95	371	302	296	296
query96	492	588	278	278
query97	2775	2750	2693	2693
query98	236	215	221	215
query99	1429	1396	1314	1314
Total cold run time: 284317 ms
Total hot run time: 193478 ms

doris-robot avatar Jun 13 '25 13:06 doris-robot

ClickBench: Total hot run time: 28.88 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b3030416106a14b8b502b9ddd3a861ddd6f9c5f3, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.03
query3	0.23	0.07	0.07
query4	1.62	0.10	0.11
query5	0.42	0.40	0.41
query6	1.15	0.66	0.66
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.58	0.50	0.53
query10	0.57	0.58	0.57
query11	0.16	0.11	0.11
query12	0.16	0.11	0.11
query13	0.61	0.61	0.59
query14	0.79	0.81	0.80
query15	0.88	0.86	0.86
query16	0.40	0.37	0.38
query17	1.05	1.04	1.05
query18	0.23	0.21	0.22
query19	2.01	1.81	1.80
query20	0.01	0.01	0.01
query21	15.42	0.94	0.54
query22	0.77	1.29	0.65
query23	14.81	1.44	0.60
query24	6.87	1.60	0.87
query25	0.46	0.10	0.13
query26	0.62	0.16	0.13
query27	0.05	0.06	0.05
query28	10.01	0.90	0.47
query29	12.52	3.97	3.31
query30	0.25	0.11	0.06
query31	2.81	0.59	0.39
query32	3.23	0.55	0.46
query33	3.09	3.15	3.11
query34	15.85	5.18	4.48
query35	4.56	4.53	4.53
query36	0.66	0.51	0.49
query37	0.09	0.07	0.07
query38	0.05	0.04	0.03
query39	0.03	0.02	0.03
query40	0.17	0.14	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.52 s
Total hot run time: 28.88 s

doris-robot avatar Jun 13 '25 13:06 doris-robot

BE UT Coverage Report

Increment line coverage 2.54% (3/118) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 56.39% (15074/26733)
Line Coverage 45.14% (134763/298513)
Region Coverage 44.27% (67832/153229)
Branch Coverage 38.83% (34805/89636)

doris-robot avatar Jun 13 '25 14:06 doris-robot

BE Regression && UT Coverage Report

Increment line coverage 2.54% (3/118) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 79.75% (20981/26310)
Line Coverage 72.69% (216881/298355)
Region Coverage 70.92% (127803/180202)
Branch Coverage 64.56% (66132/102442)

hello-stephen avatar Jun 13 '25 14:06 hello-stephen

run buildall

dwdwqfwe avatar Jun 13 '25 14:06 dwdwqfwe

BE UT Coverage Report

Increment line coverage 2.54% (3/118) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 56.39% (15074/26733)
Line Coverage 45.15% (134769/298513)
Region Coverage 44.26% (67825/153229)
Branch Coverage 38.83% (34803/89636)

doris-robot avatar Jun 13 '25 16:06 doris-robot

BE Regression && UT Coverage Report

Increment line coverage 2.54% (3/118) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 79.73% (20977/26310)
Line Coverage 72.66% (216797/298355)
Region Coverage 70.90% (127759/180202)
Branch Coverage 64.57% (66149/102442)

hello-stephen avatar Jun 13 '25 17:06 hello-stephen

run buildall

dwdwqfwe avatar Jun 14 '25 03:06 dwdwqfwe

TPC-H: Total hot run time: 33871 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ca2be51f8f98f4e1b21ae8a9887fb8aee0f4a20c, data reload: false

------ Round 1 ----------------------------------
q1	17652	5171	5005	5005
q2	1920	303	172	172
q3	10433	1293	760	760
q4	10263	1030	525	525
q5	8200	2349	2377	2349
q6	187	162	132	132
q7	909	743	604	604
q8	9316	1344	1180	1180
q9	6884	5060	5122	5060
q10	6820	2330	1915	1915
q11	502	284	282	282
q12	362	354	214	214
q13	17858	3719	3077	3077
q14	219	226	206	206
q15	565	474	477	474
q16	432	447	375	375
q17	605	857	367	367
q18	7632	7280	7061	7061
q19	1547	955	550	550
q20	350	350	227	227
q21	3928	2533	2343	2343
q22	1073	1050	993	993
Total cold run time: 107657 ms
Total hot run time: 33871 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5154	5011	5037	5011
q2	248	311	227	227
q3	2186	2642	2284	2284
q4	1424	1798	1361	1361
q5	4272	4119	4394	4119
q6	216	178	131	131
q7	2030	1940	1801	1801
q8	2626	2640	2587	2587
q9	7278	7131	7314	7131
q10	3040	3167	2680	2680
q11	594	514	526	514
q12	716	779	620	620
q13	3511	3996	3308	3308
q14	282	290	291	290
q15	541	484	477	477
q16	480	478	462	462
q17	1147	1526	1379	1379
q18	7808	7596	7418	7418
q19	794	822	931	822
q20	1977	2061	1943	1943
q21	5003	4363	4349	4349
q22	1093	1071	1032	1032
Total cold run time: 52420 ms
Total hot run time: 49946 ms

doris-robot avatar Jun 14 '25 03:06 doris-robot

TPC-DS: Total hot run time: 193304 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ca2be51f8f98f4e1b21ae8a9887fb8aee0f4a20c, data reload: false

query1	1387	1012	1010	1010
query2	6174	1851	1794	1794
query3	11101	4588	4451	4451
query4	55067	26129	23752	23752
query5	5052	525	491	491
query6	354	223	199	199
query7	4893	527	293	293
query8	302	232	211	211
query9	5967	2636	2647	2636
query10	420	322	257	257
query11	15216	15046	14796	14796
query12	158	107	106	106
query13	1044	522	400	400
query14	10161	6369	6383	6369
query15	207	226	196	196
query16	7195	664	538	538
query17	1097	762	597	597
query18	1709	462	318	318
query19	201	188	172	172
query20	130	129	120	120
query21	205	130	110	110
query22	4343	4352	4235	4235
query23	34145	33702	33901	33702
query24	6645	2403	2429	2403
query25	453	473	419	419
query26	727	274	151	151
query27	2557	515	357	357
query28	2956	2200	2216	2200
query29	582	567	428	428
query30	278	218	188	188
query31	821	882	766	766
query32	76	66	66	66
query33	460	364	330	330
query34	778	877	540	540
query35	795	833	743	743
query36	913	1020	903	903
query37	117	105	84	84
query38	4252	4354	4221	4221
query39	1521	1458	1452	1452
query40	222	120	114	114
query41	61	56	58	56
query42	120	109	115	109
query43	502	506	478	478
query44	1378	863	855	855
query45	197	180	173	173
query46	865	1029	653	653
query47	1860	1889	1770	1770
query48	410	437	320	320
query49	655	493	404	404
query50	674	705	414	414
query51	4309	4242	4251	4242
query52	120	111	101	101
query53	240	263	193	193
query54	596	586	514	514
query55	88	96	92	92
query56	302	317	300	300
query57	1202	1229	1106	1106
query58	271	279	262	262
query59	2536	2566	2550	2550
query60	352	342	313	313
query61	151	174	148	148
query62	715	725	709	709
query63	232	194	197	194
query64	1820	1046	678	678
query65	4246	4114	4144	4114
query66	750	398	312	312
query67	15840	15566	15405	15405
query68	7145	901	555	555
query69	538	308	281	281
query70	1224	1102	1076	1076
query71	500	389	317	317
query72	5782	4851	4949	4851
query73	1442	704	353	353
query74	9286	9040	8950	8950
query75	3813	3216	2687	2687
query76	4204	1194	752	752
query77	626	379	297	297
query78	10102	10247	9452	9452
query79	5684	816	586	586
query80	622	509	456	456
query81	460	329	224	224
query82	617	130	107	107
query83	341	251	237	237
query84	296	110	84	84
query85	806	359	325	325
query86	359	316	293	293
query87	4444	4418	4300	4300
query88	3450	2304	2308	2304
query89	446	310	288	288
query90	1923	281	222	222
query91	144	139	112	112
query92	76	63	60	60
query93	3059	973	587	587
query94	671	416	297	297
query95	384	292	293	292
query96	504	582	284	284
query97	2746	2725	2615	2615
query98	228	206	213	206
query99	1454	1394	1271	1271
Total cold run time: 304549 ms
Total hot run time: 193304 ms

doris-robot avatar Jun 14 '25 03:06 doris-robot

ClickBench: Total hot run time: 28.53 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ca2be51f8f98f4e1b21ae8a9887fb8aee0f4a20c, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.03	0.03
query3	0.24	0.07	0.07
query4	1.62	0.11	0.10
query5	0.43	0.43	0.42
query6	1.18	0.67	0.67
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.59	0.51	0.53
query10	0.57	0.60	0.57
query11	0.16	0.12	0.11
query12	0.15	0.12	0.11
query13	0.63	0.62	0.59
query14	0.80	0.82	0.80
query15	0.89	0.86	0.85
query16	0.39	0.38	0.38
query17	1.03	1.05	1.10
query18	0.24	0.21	0.21
query19	1.97	1.85	1.83
query20	0.01	0.01	0.02
query21	15.40	0.92	0.54
query22	0.76	1.14	0.60
query23	15.04	1.39	0.64
query24	6.93	1.64	0.43
query25	0.52	0.12	0.16
query26	0.56	0.17	0.15
query27	0.05	0.05	0.05
query28	9.41	0.92	0.44
query29	12.54	4.00	3.31
query30	0.26	0.09	0.05
query31	2.84	0.62	0.40
query32	3.23	0.56	0.47
query33	3.10	3.07	3.03
query34	15.71	5.19	4.53
query35	4.53	4.62	4.58
query36	0.66	0.49	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.17	0.14	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.13 s
Total hot run time: 28.53 s

doris-robot avatar Jun 14 '25 03:06 doris-robot

BE UT Coverage Report

Increment line coverage 2.54% (3/118) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 56.39% (15076/26733)
Line Coverage 45.15% (134782/298513)
Region Coverage 44.27% (67836/153229)
Branch Coverage 38.83% (34807/89636)

doris-robot avatar Jun 14 '25 05:06 doris-robot

BE Regression && UT Coverage Report

Increment line coverage 2.54% (3/118) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 79.81% (20999/26310)
Line Coverage 72.71% (216943/298355)
Region Coverage 70.92% (127796/180202)
Branch Coverage 64.56% (66141/102442)

hello-stephen avatar Jun 14 '25 05:06 hello-stephen

run buildall

dwdwqfwe avatar Jun 14 '25 17:06 dwdwqfwe

TPC-H: Total hot run time: 33933 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bf3cdf595c54818b394ad2f7a941ad2eff50e0e6, data reload: false

------ Round 1 ----------------------------------
q1	17596	5158	5015	5015
q2	1932	267	159	159
q3	10357	1266	735	735
q4	10291	1041	528	528
q5	8365	2336	2338	2336
q6	189	164	131	131
q7	941	736	629	629
q8	9324	1303	1067	1067
q9	6878	5037	5135	5037
q10	6870	2320	1891	1891
q11	490	295	273	273
q12	347	358	223	223
q13	17771	3687	3151	3151
q14	252	246	219	219
q15	576	482	494	482
q16	429	450	380	380
q17	605	870	371	371
q18	7364	7171	7196	7171
q19	2675	957	553	553
q20	335	333	215	215
q21	3721	3175	2409	2409
q22	1004	1049	958	958
Total cold run time: 108312 ms
Total hot run time: 33933 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5200	5012	5121	5012
q2	244	327	222	222
q3	2127	2645	2341	2341
q4	1297	1790	1362	1362
q5	4201	4241	4391	4241
q6	236	181	131	131
q7	1992	1917	1785	1785
q8	2579	2455	2526	2455
q9	7277	7216	7336	7216
q10	2963	3137	2857	2857
q11	596	513	497	497
q12	682	784	621	621
q13	3496	3925	3275	3275
q14	297	301	281	281
q15	519	497	479	479
q16	446	498	448	448
q17	1176	1545	1380	1380
q18	7577	7538	7446	7446
q19	806	817	860	817
q20	1988	2050	1877	1877
q21	5025	4458	4503	4458
q22	1111	1070	990	990
Total cold run time: 51835 ms
Total hot run time: 50191 ms

doris-robot avatar Jun 14 '25 17:06 doris-robot

run p0

dwdwqfwe avatar Jun 14 '25 17:06 dwdwqfwe

TPC-DS: Total hot run time: 196334 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bf3cdf595c54818b394ad2f7a941ad2eff50e0e6, data reload: false

query1	1409	1028	1014	1014
query2	6324	1829	1789	1789
query3	11002	4556	4495	4495
query4	54077	25313	23462	23462
query5	5025	527	482	482
query6	352	214	213	213
query7	4894	513	302	302
query8	301	233	212	212
query9	5659	2644	2670	2644
query10	443	328	277	277
query11	15092	15105	14976	14976
query12	165	115	110	110
query13	1054	540	411	411
query14	10061	6359	6331	6331
query15	212	198	204	198
query16	6969	654	483	483
query17	1057	742	596	596
query18	1568	422	311	311
query19	209	198	171	171
query20	132	122	128	122
query21	211	126	116	116
query22	4576	4497	4390	4390
query23	34567	33856	33810	33810
query24	6557	2524	2518	2518
query25	502	500	439	439
query26	685	297	158	158
query27	2307	537	355	355
query28	3262	2355	2360	2355
query29	588	595	456	456
query30	288	234	190	190
query31	918	877	820	820
query32	74	71	69	69
query33	461	404	344	344
query34	851	919	589	589
query35	810	844	768	768
query36	1062	1068	970	970
query37	126	104	81	81
query38	4323	4335	4238	4238
query39	1538	1469	1483	1469
query40	228	140	119	119
query41	72	71	66	66
query42	141	131	119	119
query43	559	548	527	527
query44	1463	945	986	945
query45	199	192	191	191
query46	934	1090	707	707
query47	1856	1900	1808	1808
query48	438	468	355	355
query49	689	563	442	442
query50	737	740	439	439
query51	4326	4302	4212	4212
query52	129	120	121	120
query53	261	286	207	207
query54	678	681	558	558
query55	88	96	89	89
query56	340	328	333	328
query57	1212	1252	1228	1228
query58	285	283	291	283
query59	2866	2999	2857	2857
query60	353	360	345	345
query61	155	153	150	150
query62	741	766	697	697
query63	253	233	206	206
query64	1476	1110	723	723
query65	4238	4207	4174	4174
query66	773	411	376	376
query67	16112	15826	15591	15591
query68	7242	953	595	595
query69	554	326	292	292
query70	1300	1208	1200	1200
query71	536	354	329	329
query72	5502	4865	4897	4865
query73	1439	653	395	395
query74	9302	8940	8866	8866
query75	3851	3280	2761	2761
query76	4264	1243	821	821
query77	656	387	313	313
query78	10045	10336	9426	9426
query79	1780	882	640	640
query80	658	579	493	493
query81	493	259	224	224
query82	418	133	103	103
query83	276	263	266	263
query84	295	126	104	104
query85	802	392	337	337
query86	349	329	306	306
query87	4473	4564	4396	4396
query88	3256	2560	2525	2525
query89	402	335	297	297
query90	1972	219	215	215
query91	162	151	126	126
query92	75	68	61	61
query93	1160	1040	659	659
query94	700	423	320	320
query95	386	314	314	314
query96	553	579	298	298
query97	2765	2816	2681	2681
query98	239	229	230	229
query99	1466	1413	1284	1284
Total cold run time: 298684 ms
Total hot run time: 196334 ms

doris-robot avatar Jun 14 '25 17:06 doris-robot

run p0

dwdwqfwe avatar Jun 14 '25 18:06 dwdwqfwe

run performance

dwdwqfwe avatar Jun 14 '25 18:06 dwdwqfwe

run performance

dwdwqfwe avatar Jun 14 '25 18:06 dwdwqfwe