doris icon indicating copy to clipboard operation
doris copied to clipboard

[Bug](distinct) fix distinct function with over return error result

Open zhangstar333 opened this issue 5 months ago • 20 comments

What problem does this PR solve?

Problem Summary: before the result is not correctly, as after insert the rows, should reset all state of nested function. So the result of the next line will not be affected by the previous one

mysql> select id, v1, multi_distinct_group_concat(v2) over() from multi;
+------+------+----------------------------------------+
| id   | v1   | multi_distinct_group_concat(v2) over() |
+------+------+----------------------------------------+
|    3 |    1 | a                                      |
|    1 |    1 | a,a                                    |
|    1 |    1 | a,a,a                                  |
|    2 |    1 | a,a,a,a                                |
+------+------+----------------------------------------+
4 rows in set (0.21 sec)

mysql> select id, v1, multi_distinct_sum(v1) over() from multi;
+------+------+-------------------------------+
| id   | v1   | multi_distinct_sum(v1) over() |
+------+------+-------------------------------+
|    1 |    1 |                             1 |
|    1 |    1 |                             2 |
|    2 |    1 |                             3 |
|    3 |    1 |                             4 |
+------+------+-------------------------------+
4 rows in set (0.06 sec)

Release note

None

Check List (For Author)

  • Test

    • [x] Regression test
    • [ ] Unit Test
    • [ ] Manual test (add detailed scripts or steps below)
    • [ ] No need to test or manual test. Explain why:
      • [ ] This is a refactor/code format and no logic has been changed.
      • [ ] Previous test can cover this change.
      • [ ] No code files have been changed.
      • [ ] Other reason
  • Behavior changed:

    • [ ] No.
    • [ ] Yes.
  • Does this need documentation?

    • [ ] No.
    • [ ] Yes.

Check List (For Reviewer who merge this PR)

  • [ ] Confirm the release note
  • [ ] Confirm test cases
  • [ ] Confirm document
  • [ ] Add branch pick label

zhangstar333 avatar Jun 18 '25 08:06 zhangstar333

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

Thearas avatar Jun 18 '25 08:06 Thearas

run buildall

zhangstar333 avatar Jun 18 '25 08:06 zhangstar333

TPC-H: Total hot run time: 33740 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ee48b8d56e21143c5b033a0ba8659a0315df56d4, data reload: false

------ Round 1 ----------------------------------
q1	17574	5185	4997	4997
q2	1946	292	169	169
q3	10292	1212	745	745
q4	10212	1018	516	516
q5	7523	2282	2412	2282
q6	179	165	133	133
q7	871	740	603	603
q8	9323	1264	1049	1049
q9	6695	5131	5097	5097
q10	6869	2340	1952	1952
q11	483	295	287	287
q12	342	352	209	209
q13	17780	3669	3068	3068
q14	233	233	216	216
q15	571	495	495	495
q16	420	440	382	382
q17	602	843	359	359
q18	7552	7198	7125	7125
q19	1376	970	548	548
q20	329	343	211	211
q21	3734	2515	2327	2327
q22	1037	1040	970	970
Total cold run time: 105943 ms
Total hot run time: 33740 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5045	5051	4987	4987
q2	235	318	224	224
q3	2158	2668	2265	2265
q4	1361	1791	1313	1313
q5	4200	4130	4165	4130
q6	205	171	129	129
q7	1970	1951	1779	1779
q8	2563	2596	2517	2517
q9	7165	7140	7271	7140
q10	3078	3249	2842	2842
q11	553	515	489	489
q12	646	716	570	570
q13	3577	3842	3305	3305
q14	286	293	278	278
q15	532	492	483	483
q16	452	508	450	450
q17	1137	1487	1379	1379
q18	7744	7655	7359	7359
q19	811	793	841	793
q20	2016	2103	1889	1889
q21	4983	4555	4241	4241
q22	1068	1064	1017	1017
Total cold run time: 51785 ms
Total hot run time: 49579 ms

doris-robot avatar Jun 18 '25 10:06 doris-robot

TPC-DS: Total hot run time: 192588 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ee48b8d56e21143c5b033a0ba8659a0315df56d4, data reload: false

query1	1389	1034	1014	1014
query2	6106	1865	1875	1865
query3	10985	4632	4554	4554
query4	55387	25776	23046	23046
query5	5088	525	479	479
query6	351	211	203	203
query7	4927	516	293	293
query8	288	242	217	217
query9	5651	2688	2720	2688
query10	453	336	282	282
query11	14994	15084	14831	14831
query12	165	110	107	107
query13	1077	528	430	430
query14	10034	6267	6382	6267
query15	210	216	186	186
query16	7119	635	485	485
query17	1087	761	613	613
query18	1661	417	329	329
query19	202	204	187	187
query20	132	126	137	126
query21	212	128	112	112
query22	4277	4268	4328	4268
query23	34308	33561	33777	33561
query24	6528	2384	2432	2384
query25	481	475	409	409
query26	715	280	152	152
query27	2250	521	358	358
query28	3076	2178	2167	2167
query29	564	564	451	451
query30	294	225	193	193
query31	863	863	791	791
query32	73	67	69	67
query33	458	354	309	309
query34	783	886	529	529
query35	800	866	761	761
query36	913	952	910	910
query37	112	102	77	77
query38	4315	4376	4253	4253
query39	1534	1505	1470	1470
query40	208	128	106	106
query41	65	57	58	57
query42	134	116	124	116
query43	500	524	505	505
query44	1380	833	851	833
query45	189	173	174	173
query46	853	1040	655	655
query47	1835	1892	1807	1807
query48	404	425	319	319
query49	655	559	398	398
query50	673	704	414	414
query51	4185	4222	4197	4197
query52	121	118	98	98
query53	235	257	181	181
query54	590	597	526	526
query55	88	82	83	82
query56	318	315	305	305
query57	1213	1262	1164	1164
query58	273	290	262	262
query59	2706	2910	2743	2743
query60	343	325	307	307
query61	127	128	132	128
query62	732	727	669	669
query63	236	193	188	188
query64	1777	1042	698	698
query65	4283	4204	4218	4204
query66	700	398	303	303
query67	15963	15546	15380	15380
query68	8293	829	527	527
query69	547	304	265	265
query70	1220	1154	1094	1094
query71	492	318	299	299
query72	5563	4741	4871	4741
query73	1464	632	364	364
query74	8965	8962	8679	8679
query75	3844	3191	2706	2706
query76	4287	1190	766	766
query77	625	373	309	309
query78	10119	10296	9434	9434
query79	2237	789	608	608
query80	636	513	433	433
query81	487	257	233	233
query82	411	127	94	94
query83	376	239	226	226
query84	296	97	82	82
query85	813	361	313	313
query86	401	302	289	289
query87	4431	4532	4379	4379
query88	3204	2280	2311	2280
query89	399	307	276	276
query90	1944	212	210	210
query91	180	141	114	114
query92	77	59	56	56
query93	1248	934	597	597
query94	677	412	294	294
query95	373	290	292	290
query96	503	566	284	284
query97	2763	2797	2618	2618
query98	247	202	200	200
query99	1436	1368	1286	1286
Total cold run time: 299206 ms
Total hot run time: 192588 ms

doris-robot avatar Jun 18 '25 10:06 doris-robot

ClickBench: Total hot run time: 29.38 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ee48b8d56e21143c5b033a0ba8659a0315df56d4, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.04
query3	0.24	0.07	0.07
query4	1.61	0.11	0.10
query5	0.43	0.41	0.40
query6	1.17	0.65	0.66
query7	0.02	0.01	0.02
query8	0.05	0.03	0.03
query9	0.58	0.51	0.50
query10	0.57	0.58	0.56
query11	0.16	0.11	0.12
query12	0.15	0.11	0.11
query13	0.63	0.61	0.61
query14	0.81	0.81	0.81
query15	0.90	0.85	0.90
query16	0.38	0.38	0.41
query17	1.05	1.07	1.08
query18	0.23	0.22	0.21
query19	1.98	1.84	1.84
query20	0.02	0.01	0.01
query21	15.40	0.91	0.54
query22	0.75	1.14	0.65
query23	15.00	1.39	0.64
query24	7.02	1.42	0.67
query25	0.52	0.16	0.13
query26	0.60	0.16	0.14
query27	0.06	0.05	0.05
query28	8.95	0.85	0.46
query29	12.58	4.01	3.34
query30	0.25	0.09	0.06
query31	2.83	0.59	0.40
query32	3.22	0.54	0.47
query33	3.11	3.17	3.08
query34	16.11	5.37	4.76
query35	4.77	4.82	4.79
query36	0.68	0.50	0.49
query37	0.09	0.07	0.07
query38	0.05	0.05	0.03
query39	0.03	0.02	0.03
query40	0.18	0.15	0.14
query41	0.08	0.02	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.04
Total cold run time: 103.43 s
Total hot run time: 29.38 s

doris-robot avatar Jun 18 '25 10:06 doris-robot

BE UT Coverage Report

Increment line coverage 0.00% (0/1) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 56.34% (15050/26713)
Line Coverage 45.11% (134594/298391)
Region Coverage 44.24% (67692/153007)
Branch Coverage 38.82% (34728/89458)

hello-stephen avatar Jun 18 '25 11:06 hello-stephen

BE Regression && UT Coverage Report

Increment line coverage 0.00% (0/1) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 61.11% (16065/26290)
Line Coverage 50.66% (151079/298232)
Region Coverage 47.97% (86343/179976)
Branch Coverage 41.49% (42431/102262)

hello-stephen avatar Jun 18 '25 11:06 hello-stephen

BE Regression && UT Coverage Report

Increment line coverage 0.00% (0/1) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 61.11% (16065/26290)
Line Coverage 50.66% (151079/298232)
Region Coverage 47.97% (86343/179976)
Branch Coverage 41.49% (42431/102262)

hello-stephen avatar Jun 18 '25 11:06 hello-stephen

run buildall

zhangstar333 avatar Jun 18 '25 11:06 zhangstar333

TPC-H: Total hot run time: 33823 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9318fed02282bbbbc109aa1f0babe98f634fe100, data reload: false

------ Round 1 ----------------------------------
q1	17726	5186	5005	5005
q2	1917	291	185	185
q3	10420	1291	710	710
q4	10227	1003	541	541
q5	7572	2372	2301	2301
q6	177	162	131	131
q7	909	741	610	610
q8	9322	1256	1067	1067
q9	6769	5092	5069	5069
q10	6892	2362	1945	1945
q11	477	288	273	273
q12	355	346	216	216
q13	17755	3696	3107	3107
q14	226	229	212	212
q15	562	471	491	471
q16	425	431	373	373
q17	611	886	376	376
q18	7632	7134	7083	7083
q19	1663	972	575	575
q20	344	340	229	229
q21	3839	3175	2349	2349
q22	1053	1005	995	995
Total cold run time: 106873 ms
Total hot run time: 33823 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5123	4975	5037	4975
q2	240	318	227	227
q3	2176	2632	2304	2304
q4	1378	1802	1372	1372
q5	4196	4108	4125	4108
q6	204	175	126	126
q7	1899	1866	1670	1670
q8	2496	2440	2385	2385
q9	6787	6782	6827	6782
q10	2933	3127	2717	2717
q11	574	503	468	468
q12	667	742	576	576
q13	3349	3673	3080	3080
q14	266	275	254	254
q15	516	472	469	469
q16	423	478	420	420
q17	1142	1519	1348	1348
q18	7291	7163	7238	7163
q19	765	781	879	781
q20	1920	1943	1814	1814
q21	4720	4346	4333	4333
q22	1058	1019	991	991
Total cold run time: 50123 ms
Total hot run time: 48363 ms

doris-robot avatar Jun 18 '25 13:06 doris-robot

TPC-DS: Total hot run time: 185993 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9318fed02282bbbbc109aa1f0babe98f634fe100, data reload: false

query1	1010	393	392	392
query2	6518	1925	1901	1901
query3	6741	226	219	219
query4	26178	23643	23055	23055
query5	4960	641	472	472
query6	326	220	200	200
query7	4634	492	297	297
query8	283	241	217	217
query9	8649	2613	2642	2613
query10	537	335	273	273
query11	15719	15000	15080	15000
query12	171	112	106	106
query13	1655	526	432	432
query14	9723	6181	6154	6154
query15	199	197	182	182
query16	7672	617	474	474
query17	1159	741	586	586
query18	2039	427	315	315
query19	195	199	159	159
query20	124	119	118	118
query21	221	125	114	114
query22	4113	4146	3925	3925
query23	33992	33057	33249	33057
query24	8408	2347	2414	2347
query25	505	463	402	402
query26	1224	277	153	153
query27	2696	504	342	342
query28	4298	2132	2121	2121
query29	739	562	427	427
query30	282	220	201	201
query31	944	829	738	738
query32	72	66	66	66
query33	582	362	306	306
query34	790	831	550	550
query35	768	796	738	738
query36	961	959	856	856
query37	112	96	81	81
query38	4093	4247	4094	4094
query39	1491	1429	1617	1429
query40	216	120	107	107
query41	63	58	57	57
query42	122	106	109	106
query43	506	530	481	481
query44	1314	830	830	830
query45	188	174	166	166
query46	829	1027	624	624
query47	1739	1785	1717	1717
query48	385	428	314	314
query49	724	502	418	418
query50	644	687	400	400
query51	4184	4199	4123	4123
query52	112	107	91	91
query53	220	258	181	181
query54	575	569	507	507
query55	92	82	81	81
query56	309	312	290	290
query57	1166	1191	1108	1108
query58	268	256	263	256
query59	2637	2835	2672	2672
query60	319	328	301	301
query61	133	124	122	122
query62	778	728	652	652
query63	225	193	179	179
query64	4252	1001	692	692
query65	4253	4226	4238	4226
query66	1065	449	311	311
query67	15791	15607	15637	15607
query68	8196	907	533	533
query69	473	302	267	267
query70	1223	1113	1142	1113
query71	490	310	303	303
query72	5750	4682	4643	4643
query73	676	564	355	355
query74	8943	9074	8811	8811
query75	3857	3184	2670	2670
query76	3752	1203	752	752
query77	780	377	304	304
query78	10033	10161	9335	9335
query79	2511	824	574	574
query80	615	506	443	443
query81	526	258	225	225
query82	456	125	98	98
query83	278	250	239	239
query84	294	113	94	94
query85	768	358	307	307
query86	323	297	275	275
query87	4545	4397	4450	4397
query88	3290	2282	2318	2282
query89	378	330	282	282
query90	1986	205	201	201
query91	141	146	117	117
query92	80	61	63	61
query93	1676	928	589	589
query94	668	409	308	308
query95	374	289	305	289
query96	493	568	282	282
query97	2746	2767	2650	2650
query98	236	207	204	204
query99	1442	1403	1259	1259
Total cold run time: 275891 ms
Total hot run time: 185993 ms

doris-robot avatar Jun 18 '25 13:06 doris-robot

ClickBench: Total hot run time: 29.28 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9318fed02282bbbbc109aa1f0babe98f634fe100, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.04	0.03
query3	0.24	0.07	0.06
query4	1.61	0.10	0.10
query5	0.42	0.44	0.41
query6	1.17	0.66	0.66
query7	0.02	0.02	0.01
query8	0.05	0.04	0.03
query9	0.57	0.51	0.50
query10	0.58	0.58	0.56
query11	0.15	0.11	0.11
query12	0.15	0.12	0.12
query13	0.62	0.62	0.62
query14	0.79	0.83	0.81
query15	0.88	0.86	0.88
query16	0.38	0.37	0.40
query17	1.07	1.03	1.04
query18	0.23	0.21	0.22
query19	1.92	1.83	1.91
query20	0.01	0.01	0.01
query21	15.40	0.95	0.55
query22	0.76	1.14	0.67
query23	14.95	1.39	0.65
query24	6.90	2.07	0.49
query25	0.49	0.26	0.15
query26	0.71	0.16	0.13
query27	0.06	0.05	0.04
query28	9.25	0.87	0.44
query29	12.55	4.01	3.37
query30	0.25	0.09	0.07
query31	2.83	0.60	0.39
query32	3.25	0.55	0.47
query33	3.05	3.10	3.06
query34	16.02	5.41	4.76
query35	4.81	4.85	4.83
query36	0.67	0.50	0.49
query37	0.09	0.07	0.07
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.18	0.15	0.14
query41	0.09	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.03	0.04
Total cold run time: 103.43 s
Total hot run time: 29.28 s

doris-robot avatar Jun 18 '25 13:06 doris-robot

BE UT Coverage Report

Increment line coverage 0.00% (0/1) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 56.35% (15051/26709)
Line Coverage 45.11% (134620/298410)
Region Coverage 44.25% (67706/153016)
Branch Coverage 38.84% (34745/89464)

doris-robot avatar Jun 18 '25 14:06 doris-robot

BE Regression && UT Coverage Report

Increment line coverage 0.00% (0/1) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 61.22% (16090/26284)
Line Coverage 50.73% (151316/298249)
Region Coverage 48.07% (86517/179998)
Branch Coverage 41.58% (42522/102274)

hello-stephen avatar Jun 18 '25 14:06 hello-stephen

BE Regression && UT Coverage Report

Increment line coverage 0.00% (0/1) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 61.22% (16090/26284)
Line Coverage 50.73% (151316/298249)
Region Coverage 48.07% (86517/179998)
Branch Coverage 41.58% (42522/102274)

hello-stephen avatar Jun 18 '25 14:06 hello-stephen

run buildall

zhangstar333 avatar Jun 19 '25 03:06 zhangstar333

run buildall

zhangstar333 avatar Jun 19 '25 04:06 zhangstar333

TPC-H: Total hot run time: 33902 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c578792b036568f2b5bb60ab07adb6379b6855eb, data reload: false

------ Round 1 ----------------------------------
q1	17631	5239	5038	5038
q2	1924	297	184	184
q3	10357	1314	713	713
q4	10224	1009	510	510
q5	7523	2330	2358	2330
q6	180	162	132	132
q7	917	753	624	624
q8	9325	1283	1056	1056
q9	6760	5159	5091	5091
q10	6945	2398	1970	1970
q11	492	285	272	272
q12	342	343	216	216
q13	17801	3645	3063	3063
q14	231	228	215	215
q15	548	475	480	475
q16	437	432	373	373
q17	589	850	374	374
q18	7610	7111	7155	7111
q19	2178	1248	584	584
q20	328	325	219	219
q21	3626	3169	2333	2333
q22	1090	1022	1019	1019
Total cold run time: 107058 ms
Total hot run time: 33902 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5650	5036	5055	5036
q2	248	334	236	236
q3	2159	2650	2324	2324
q4	1361	1723	1354	1354
q5	4200	4163	4313	4163
q6	212	170	130	130
q7	2035	1950	1716	1716
q8	2555	2680	2512	2512
q9	7116	7162	7155	7155
q10	3036	3254	2819	2819
q11	591	520	481	481
q12	675	774	582	582
q13	3520	3880	3280	3280
q14	268	302	269	269
q15	526	473	463	463
q16	448	485	434	434
q17	1118	1732	1377	1377
q18	7584	7212	7094	7094
q19	785	774	904	774
q20	1875	1944	1823	1823
q21	4763	4295	4297	4295
q22	1071	1045	993	993
Total cold run time: 51796 ms
Total hot run time: 49310 ms

doris-robot avatar Jun 19 '25 05:06 doris-robot

TPC-DS: Total hot run time: 185985 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c578792b036568f2b5bb60ab07adb6379b6855eb, data reload: false

query1	983	392	384	384
query2	6560	1829	1793	1793
query3	6747	224	222	222
query4	27116	23719	23236	23236
query5	4348	612	465	465
query6	298	225	195	195
query7	4620	488	300	300
query8	279	230	218	218
query9	8624	2632	2633	2632
query10	506	333	275	275
query11	15302	15153	14898	14898
query12	161	116	111	111
query13	1657	534	416	416
query14	9317	6206	6101	6101
query15	203	201	187	187
query16	7300	624	487	487
query17	1179	704	546	546
query18	1968	405	312	312
query19	184	184	160	160
query20	129	122	119	119
query21	221	126	112	112
query22	4129	4160	4110	4110
query23	33867	33174	33042	33042
query24	8456	2392	2421	2392
query25	552	434	397	397
query26	1241	265	159	159
query27	2772	501	353	353
query28	4300	2118	2094	2094
query29	765	562	441	441
query30	287	222	187	187
query31	946	842	749	749
query32	75	65	67	65
query33	569	371	307	307
query34	811	847	566	566
query35	793	798	729	729
query36	935	994	878	878
query37	110	101	79	79
query38	4252	4136	4022	4022
query39	1481	1430	1411	1411
query40	213	129	123	123
query41	88	68	67	67
query42	128	108	113	108
query43	504	509	482	482
query44	1354	853	825	825
query45	186	178	169	169
query46	825	1028	652	652
query47	1751	1790	1755	1755
query48	386	440	323	323
query49	776	484	428	428
query50	693	675	427	427
query51	4179	4191	4079	4079
query52	112	112	99	99
query53	227	255	188	188
query54	567	575	493	493
query55	81	84	83	83
query56	317	297	288	288
query57	1175	1180	1132	1132
query58	273	254	245	245
query59	2515	2626	2610	2610
query60	328	319	314	314
query61	134	129	128	128
query62	814	724	655	655
query63	227	188	193	188
query64	4359	987	659	659
query65	4265	4166	4214	4166
query66	1128	417	309	309
query67	15828	15531	15302	15302
query68	7969	873	520	520
query69	470	301	279	279
query70	1134	1112	1085	1085
query71	458	336	301	301
query72	5347	4820	4827	4820
query73	719	676	356	356
query74	8827	9278	8886	8886
query75	3904	3189	2722	2722
query76	3740	1258	755	755
query77	794	395	291	291
query78	9913	10174	9280	9280
query79	2096	829	613	613
query80	610	507	449	449
query81	468	256	268	256
query82	431	131	97	97
query83	284	257	235	235
query84	297	110	95	95
query85	787	355	314	314
query86	333	294	277	277
query87	4369	4408	4351	4351
query88	3014	2296	2305	2296
query89	376	318	300	300
query90	1931	216	214	214
query91	141	142	123	123
query92	82	63	57	57
query93	1141	933	580	580
query94	674	415	307	307
query95	368	290	280	280
query96	511	568	279	279
query97	2725	2797	2657	2657
query98	220	210	218	210
query99	1444	1407	1253	1253
Total cold run time: 273053 ms
Total hot run time: 185985 ms

doris-robot avatar Jun 19 '25 05:06 doris-robot

ClickBench: Total hot run time: 29.72 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c578792b036568f2b5bb60ab07adb6379b6855eb, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.61	0.10	0.11
query5	0.43	0.43	0.42
query6	1.15	0.65	0.67
query7	0.02	0.01	0.02
query8	0.04	0.04	0.03
query9	0.57	0.52	0.54
query10	0.57	0.57	0.56
query11	0.17	0.12	0.11
query12	0.16	0.11	0.11
query13	0.64	0.61	0.61
query14	0.81	0.82	0.83
query15	0.89	0.88	0.87
query16	0.39	0.38	0.40
query17	1.04	1.04	1.01
query18	0.24	0.21	0.21
query19	1.98	1.86	1.84
query20	0.01	0.02	0.01
query21	15.39	0.94	0.55
query22	0.75	1.21	0.63
query23	14.93	1.41	0.62
query24	6.77	1.32	0.97
query25	0.44	0.26	0.10
query26	0.58	0.17	0.13
query27	0.06	0.05	0.05
query28	9.26	0.93	0.48
query29	12.53	4.07	3.33
query30	0.25	0.10	0.07
query31	2.82	0.60	0.39
query32	3.25	0.56	0.47
query33	3.08	3.07	3.09
query34	16.04	5.41	4.80
query35	4.91	4.86	4.87
query36	0.71	0.52	0.49
query37	0.09	0.06	0.07
query38	0.04	0.04	0.04
query39	0.04	0.02	0.02
query40	0.17	0.15	0.13
query41	0.08	0.03	0.02
query42	0.03	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 103.31 s
Total hot run time: 29.72 s

doris-robot avatar Jun 19 '25 05:06 doris-robot

BE UT Coverage Report

Increment line coverage 0.00% (0/7) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 56.34% (15049/26710)
Line Coverage 45.12% (134614/298379)
Region Coverage 44.26% (67711/153000)
Branch Coverage 38.83% (34737/89452)

doris-robot avatar Jun 19 '25 07:06 doris-robot

BE Regression && UT Coverage Report

Increment line coverage 0.00% (0/7) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 61.09% (16057/26285)
Line Coverage 50.59% (150883/298218)
Region Coverage 47.95% (86295/179987)
Branch Coverage 41.43% (42363/102264)

hello-stephen avatar Jun 19 '25 08:06 hello-stephen

run buildall

zhangstar333 avatar Jun 24 '25 06:06 zhangstar333

TPC-H: Total hot run time: 33940 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 571fbb837d2bb62cc18c7160b02068297099c99f, data reload: false

------ Round 1 ----------------------------------
q1	17592	5178	5123	5123
q2	1938	313	183	183
q3	10574	1283	700	700
q4	10242	998	525	525
q5	7838	2376	2305	2305
q6	182	165	132	132
q7	914	763	599	599
q8	9320	1299	1155	1155
q9	6732	5073	5045	5045
q10	6886	2372	1988	1988
q11	482	299	276	276
q12	344	351	221	221
q13	17755	3702	3073	3073
q14	248	224	223	223
q15	561	471	485	471
q16	434	438	369	369
q17	627	885	381	381
q18	7452	7166	7044	7044
q19	1648	946	556	556
q20	348	346	231	231
q21	3928	2572	2369	2369
q22	1049	1022	971	971
Total cold run time: 107094 ms
Total hot run time: 33940 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5166	5094	5130	5094
q2	253	323	225	225
q3	2146	2618	2279	2279
q4	1396	1753	1338	1338
q5	4221	4358	4395	4358
q6	219	170	128	128
q7	1984	1841	1763	1763
q8	2566	2477	2508	2477
q9	7149	7074	7076	7074
q10	3065	3267	2883	2883
q11	578	518	496	496
q12	688	749	628	628
q13	3464	4002	3300	3300
q14	288	292	260	260
q15	509	492	487	487
q16	457	483	439	439
q17	1126	1511	1330	1330
q18	7268	7124	7005	7005
q19	783	745	841	745
q20	1900	1979	1821	1821
q21	4736	4469	4252	4252
q22	1073	1040	993	993
Total cold run time: 51035 ms
Total hot run time: 49375 ms

doris-robot avatar Jun 24 '25 07:06 doris-robot

TPC-DS: Total hot run time: 185541 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 571fbb837d2bb62cc18c7160b02068297099c99f, data reload: false

query1	983	409	407	407
query2	6536	1829	1848	1829
query3	6748	218	221	218
query4	26234	23491	22929	22929
query5	4361	654	465	465
query6	309	216	208	208
query7	4627	514	295	295
query8	277	236	211	211
query9	8641	2614	2633	2614
query10	484	335	299	299
query11	15229	15066	15166	15066
query12	175	115	110	110
query13	1660	547	429	429
query14	10187	6184	6245	6184
query15	211	198	179	179
query16	7650	640	456	456
query17	1236	719	588	588
query18	2021	411	310	310
query19	197	194	171	171
query20	121	116	121	116
query21	221	127	109	109
query22	4191	4113	3929	3929
query23	33917	33023	33048	33023
query24	8297	2339	2373	2339
query25	534	463	386	386
query26	1097	272	151	151
query27	2700	510	358	358
query28	4297	2148	2127	2127
query29	707	537	432	432
query30	286	230	191	191
query31	922	834	754	754
query32	73	66	62	62
query33	545	406	304	304
query34	798	855	553	553
query35	795	815	722	722
query36	941	957	876	876
query37	115	104	80	80
query38	4136	4077	4028	4028
query39	1436	1462	1415	1415
query40	215	118	111	111
query41	62	61	61	61
query42	127	108	110	108
query43	499	518	484	484
query44	1346	830	857	830
query45	188	173	170	170
query46	851	1016	625	625
query47	1740	1768	1709	1709
query48	385	443	335	335
query49	747	482	408	408
query50	643	692	406	406
query51	4089	4130	4058	4058
query52	111	112	106	106
query53	234	253	191	191
query54	579	565	506	506
query55	86	84	88	84
query56	324	324	274	274
query57	1172	1194	1090	1090
query58	274	264	256	256
query59	2555	2641	2456	2456
query60	320	316	305	305
query61	126	125	118	118
query62	801	709	661	661
query63	226	189	189	189
query64	4032	1037	690	690
query65	4225	4155	4160	4155
query66	998	416	331	331
query67	15973	15618	15315	15315
query68	8438	913	538	538
query69	471	306	277	277
query70	1208	1051	1075	1051
query71	476	329	305	305
query72	5618	4800	4897	4800
query73	750	677	363	363
query74	8895	9263	8996	8996
query75	3890	3220	2704	2704
query76	3606	1197	752	752
query77	799	386	294	294
query78	10034	10448	9326	9326
query79	1759	874	594	594
query80	619	531	469	469
query81	487	264	221	221
query82	421	129	102	102
query83	272	267	235	235
query84	247	107	90	90
query85	812	456	306	306
query86	335	303	283	283
query87	4437	4436	4323	4323
query88	2987	2315	2307	2307
query89	385	318	289	289
query90	1934	208	207	207
query91	144	139	111	111
query92	70	60	61	60
query93	1065	957	607	607
query94	674	405	300	300
query95	371	290	281	281
query96	504	568	279	279
query97	2693	2726	2638	2638
query98	229	214	209	209
query99	1640	1389	1269	1269
Total cold run time: 273093 ms
Total hot run time: 185541 ms

doris-robot avatar Jun 24 '25 07:06 doris-robot

TPC-H: Total hot run time: 34162 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 571fbb837d2bb62cc18c7160b02068297099c99f, data reload: false

------ Round 1 ----------------------------------
q1	17594	5272	5106	5106
q2	1952	308	184	184
q3	10587	1331	737	737
q4	10298	1024	525	525
q5	8111	2296	2397	2296
q6	182	164	133	133
q7	900	762	611	611
q8	9317	1365	1098	1098
q9	6832	5159	5167	5159
q10	6887	2378	1947	1947
q11	489	304	282	282
q12	346	350	226	226
q13	17765	3660	3117	3117
q14	229	236	221	221
q15	554	483	469	469
q16	431	433	375	375
q17	596	853	369	369
q18	7692	7325	7191	7191
q19	1396	960	552	552
q20	333	334	226	226
q21	3869	3189	2354	2354
q22	1073	1019	984	984
Total cold run time: 107433 ms
Total hot run time: 34162 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5190	5134	5115	5115
q2	246	320	221	221
q3	2206	2672	2310	2310
q4	1390	1805	1381	1381
q5	4309	4332	4429	4332
q6	223	175	130	130
q7	2035	1932	1757	1757
q8	2604	2526	2477	2477
q9	7174	7154	7089	7089
q10	3032	3263	2808	2808
q11	578	503	487	487
q12	667	761	604	604
q13	3525	3896	3286	3286
q14	278	289	279	279
q15	531	481	464	464
q16	473	473	425	425
q17	1165	1453	1368	1368
q18	7331	7059	7214	7059
q19	797	809	903	809
q20	1923	1955	1841	1841
q21	4749	4297	4335	4297
q22	1067	1033	986	986
Total cold run time: 51493 ms
Total hot run time: 49525 ms

doris-robot avatar Jun 24 '25 08:06 doris-robot

BE UT Coverage Report

Increment line coverage 0.00% (0/7) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 56.45% (15083/26718)
Line Coverage 45.26% (135133/298587)
Region Coverage 44.50% (68112/153068)
Branch Coverage 39.14% (35048/89546)

hello-stephen avatar Jun 24 '25 08:06 hello-stephen

TPC-DS: Total hot run time: 185506 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 571fbb837d2bb62cc18c7160b02068297099c99f, data reload: false

query1	989	411	388	388
query2	6553	1844	1814	1814
query3	6745	219	218	218
query4	26327	23471	23369	23369
query5	4462	637	474	474
query6	320	213	201	201
query7	4627	493	294	294
query8	284	227	222	222
query9	8666	2637	2639	2637
query10	494	335	306	306
query11	15706	15331	14829	14829
query12	177	109	105	105
query13	1657	525	394	394
query14	9776	6073	6026	6026
query15	200	191	183	183
query16	7581	624	485	485
query17	1201	718	573	573
query18	2017	423	301	301
query19	191	194	167	167
query20	122	114	111	111
query21	213	132	112	112
query22	4182	4124	3964	3964
query23	33911	33077	33022	33022
query24	8410	2341	2371	2341
query25	559	503	412	412
query26	1239	280	153	153
query27	2744	506	354	354
query28	4307	2140	2113	2113
query29	730	561	456	456
query30	286	215	203	203
query31	949	858	759	759
query32	73	68	64	64
query33	588	390	350	350
query34	801	852	542	542
query35	793	841	740	740
query36	938	981	888	888
query37	117	101	80	80
query38	4114	4071	4050	4050
query39	1466	1452	1417	1417
query40	215	121	109	109
query41	61	58	58	58
query42	130	112	109	109
query43	489	499	470	470
query44	1333	830	820	820
query45	179	170	167	167
query46	851	1020	621	621
query47	1741	1812	1716	1716
query48	376	426	309	309
query49	735	490	386	386
query50	643	680	408	408
query51	4280	4198	4115	4115
query52	114	106	98	98
query53	227	253	179	179
query54	575	566	504	504
query55	86	85	85	85
query56	292	307	297	297
query57	1173	1211	1124	1124
query58	267	269	256	256
query59	2516	2587	2641	2587
query60	326	315	315	315
query61	126	126	128	126
query62	799	715	663	663
query63	230	190	186	186
query64	4212	1031	670	670
query65	4316	4191	4155	4155
query66	1048	415	352	352
query67	15858	15679	15293	15293
query68	8529	904	536	536
query69	477	302	275	275
query70	1205	1154	1047	1047
query71	466	330	305	305
query72	5646	4774	4780	4774
query73	729	625	357	357
query74	8956	8958	8910	8910
query75	4072	3246	2685	2685
query76	3727	1188	732	732
query77	790	383	302	302
query78	10097	10029	9269	9269
query79	4083	809	567	567
query80	678	505	440	440
query81	486	260	224	224
query82	554	131	105	105
query83	293	251	233	233
query84	301	114	91	91
query85	803	352	310	310
query86	394	301	285	285
query87	4415	4406	4232	4232
query88	3397	2294	2261	2261
query89	443	320	285	285
query90	1931	208	204	204
query91	142	142	121	121
query92	78	62	57	57
query93	3186	933	598	598
query94	666	390	279	279
query95	379	288	284	284
query96	497	574	277	277
query97	2730	2784	2638	2638
query98	233	215	213	213
query99	1445	1388	1315	1315
Total cold run time: 279541 ms
Total hot run time: 185506 ms

doris-robot avatar Jun 24 '25 08:06 doris-robot

ClickBench: Total hot run time: 29.69 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 571fbb837d2bb62cc18c7160b02068297099c99f, data reload: false

query1	0.04	0.04	0.02
query2	0.07	0.04	0.04
query3	0.24	0.07	0.06
query4	1.62	0.10	0.10
query5	0.44	0.40	0.43
query6	1.16	0.67	0.65
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.58	0.50	0.52
query10	0.57	0.58	0.57
query11	0.15	0.11	0.11
query12	0.15	0.12	0.11
query13	0.63	0.61	0.61
query14	0.79	0.81	0.83
query15	0.90	0.89	0.89
query16	0.37	0.39	0.39
query17	1.02	1.06	1.05
query18	0.23	0.20	0.21
query19	1.92	1.84	1.79
query20	0.01	0.01	0.01
query21	15.39	0.89	0.55
query22	0.76	1.37	0.94
query23	14.71	1.39	0.60
query24	7.27	0.88	0.70
query25	0.50	0.13	0.17
query26	0.59	0.17	0.13
query27	0.06	0.06	0.05
query28	9.06	0.92	0.44
query29	12.53	3.96	3.36
query30	0.26	0.09	0.06
query31	2.82	0.60	0.39
query32	3.25	0.57	0.49
query33	3.03	3.07	3.09
query34	15.88	5.39	4.78
query35	4.78	4.83	4.84
query36	0.68	0.50	0.49
query37	0.09	0.06	0.06
query38	0.06	0.04	0.03
query39	0.03	0.02	0.03
query40	0.17	0.14	0.14
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 103.04 s
Total hot run time: 29.69 s

doris-robot avatar Jun 24 '25 08:06 doris-robot

BE Regression && UT Coverage Report

Increment line coverage 0.00% (0/7) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 61.93% (16280/26286)
Line Coverage 51.47% (153595/298405)
Region Coverage 48.95% (88124/180046)
Branch Coverage 42.44% (43424/102320)

hello-stephen avatar Jun 24 '25 09:06 hello-stephen