doris icon indicating copy to clipboard operation
doris copied to clipboard

[chore](translator) set stream agg when translate agg

Open morrySnow opened this issue 2 weeks ago • 5 comments

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • [ ] Regression test
    • [ ] Unit Test
    • [ ] Manual test (add detailed scripts or steps below)
    • [ ] No need to test or manual test. Explain why:
      • [ ] This is a refactor/code format and no logic has been changed.
      • [ ] Previous test can cover this change.
      • [ ] No code files have been changed.
      • [ ] Other reason
  • Behavior changed:

    • [ ] No.
    • [ ] Yes.
  • Does this need documentation?

    • [ ] No.
    • [ ] Yes.

Check List (For Reviewer who merge this PR)

  • [ ] Confirm the release note
  • [ ] Confirm test cases
  • [ ] Confirm document
  • [ ] Add branch pick label

morrySnow avatar Dec 11 '25 10:12 morrySnow

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

Thearas avatar Dec 11 '25 10:12 Thearas

run buildall

morrySnow avatar Dec 11 '25 10:12 morrySnow

TPC-H: Total hot run time: 36982 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 060d01cdeaf6bc4402a61a840e3a00e4b928b9af, data reload: false

------ Round 1 ----------------------------------
q1	17684	4275	4217	4217
q2	2031	355	241	241
q3	10164	1328	746	746
q4	10232	879	321	321
q5	7541	2158	1942	1942
q6	188	170	133	133
q7	1028	858	718	718
q8	9367	1459	1226	1226
q9	6997	5348	5363	5348
q10	6813	2405	1958	1958
q11	536	320	302	302
q12	635	735	589	589
q13	17773	3721	3093	3093
q14	294	297	284	284
q15	595	522	513	513
q16	928	931	882	882
q17	719	827	536	536
q18	7452	7813	7802	7802
q19	1273	1002	620	620
q20	421	377	258	258
q21	4730	4190	4239	4190
q22	1111	1087	1063	1063
Total cold run time: 108512 ms
Total hot run time: 36982 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4309	4240	4334	4240
q2	319	412	334	334
q3	2369	2839	2565	2565
q4	1447	1877	1424	1424
q5	4557	4729	4414	4414
q6	212	165	121	121
q7	1980	1980	1811	1811
q8	2699	2527	2566	2527
q9	7556	7509	7566	7509
q10	3111	3241	2743	2743
q11	570	491	481	481
q12	638	700	562	562
q13	3290	3661	3094	3094
q14	266	282	261	261
q15	528	492	496	492
q16	859	891	850	850
q17	1139	1408	1363	1363
q18	7252	7058	7150	7058
q19	847	792	848	792
q20	1906	1986	1839	1839
q21	4651	4259	4140	4140
q22	1041	1026	969	969
Total cold run time: 51546 ms
Total hot run time: 49589 ms

doris-robot avatar Dec 11 '25 11:12 doris-robot

TPC-DS: Total hot run time: 181772 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 060d01cdeaf6bc4402a61a840e3a00e4b928b9af, data reload: false

query5	5401	629	467	467
query6	385	243	231	231
query7	4238	471	298	298
query8	307	249	241	241
query9	8794	2609	2622	2609
query10	553	395	344	344
query11	15601	15108	14661	14661
query12	199	120	118	118
query13	1296	517	401	401
query14	6997	3285	3017	3017
query14_1	2890	2930	2961	2930
query15	207	202	180	180
query16	894	486	526	486
query17	1175	684	596	596
query18	2698	441	343	343
query19	230	239	217	217
query20	119	115	109	109
query21	216	138	119	119
query22	3918	3969	3961	3961
query23	16756	16180	15964	15964
query23_1	16017	15911	16109	15911
query24	7180	1664	1237	1237
query24_1	1259	1237	1291	1237
query25	549	465	430	430
query26	1270	272	171	171
query27	2742	486	314	314
query28	4461	2168	2151	2151
query29	806	545	436	436
query30	316	249	215	215
query31	817	722	632	632
query32	78	76	70	70
query33	536	349	288	288
query34	915	920	574	574
query35	801	868	760	760
query36	879	919	813	813
query37	144	99	80	80
query38	3812	3846	3811	3811
query39	779	731	710	710
query39_1	705	712	702	702
query40	230	144	125	125
query41	65	61	62	61
query42	112	107	111	107
query43	459	439	418	418
query44	1363	764	767	764
query45	189	197	183	183
query46	935	987	630	630
query47	1682	1664	1610	1610
query48	328	327	254	254
query49	647	440	356	356
query50	683	292	219	219
query51	3808	3868	3881	3868
query52	104	108	102	102
query53	325	358	300	300
query54	294	273	257	257
query55	81	79	75	75
query56	293	308	302	302
query57	1163	1143	1087	1087
query58	272	263	254	254
query59	2360	2518	2454	2454
query60	309	320	292	292
query61	167	158	156	156
query62	508	461	435	435
query63	336	305	314	305
query64	4994	1342	1137	1137
query65	4026	3972	3935	3935
query66	1403	470	345	345
query67	15189	15007	14788	14788
query68	3375	1076	762	762
query69	490	361	315	315
query70	1091	1001	990	990
query71	350	297	295	295
query72	6263	5001	5095	5001
query73	662	635	314	314
query74	8932	8837	8749	8749
query75	3574	3563	3188	3188
query76	3695	1094	691	691
query77	529	390	299	299
query78	9447	9607	8921	8921
query79	1043	877	632	632
query80	1157	655	558	558
query81	550	275	235	235
query82	221	134	111	111
query83	371	252	235	235
query84	253	118	97	97
query85	961	521	479	479
query86	406	297	298	297
query87	4072	4070	4079	4070
query88	3180	2277	2259	2259
query89	475	424	399	399
query90	1933	162	159	159
query91	177	166	147	147
query92	73	68	69	68
query93	991	939	567	567
query94	533	292	288	288
query95	572	411	329	329
query96	592	460	217	217
query97	2661	2692	2556	2556
query98	209	203	196	196
query99	819	871	764	764
Total cold run time: 258745 ms
Total hot run time: 181772 ms

doris-robot avatar Dec 11 '25 11:12 doris-robot

FE Regression Coverage Report

Increment line coverage 100.00% (3/3) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 11 '25 13:12 hello-stephen

run buildall

morrySnow avatar Dec 12 '25 09:12 morrySnow

run buildall

morrySnow avatar Dec 15 '25 03:12 morrySnow

TPC-H: Total hot run time: 35233 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cc7389fa6455e6ddf688b026ba5c24d941258248, data reload: false

------ Round 1 ----------------------------------
q1	17592	4189	4084	4084
q2	2033	353	251	251
q3	10193	1327	759	759
q4	10245	834	324	324
q5	8769	2189	1933	1933
q6	243	170	137	137
q7	1021	877	711	711
q8	9364	1478	1222	1222
q9	7130	5393	5385	5385
q10	6863	2398	1965	1965
q11	529	318	285	285
q12	749	741	575	575
q13	17787	3653	3084	3084
q14	293	305	295	295
q15	589	519	515	515
q16	702	686	627	627
q17	687	821	533	533
q18	7955	7133	6976	6976
q19	1107	976	592	592
q20	405	369	248	248
q21	4181	3941	3767	3767
q22	1068	1010	965	965
Total cold run time: 109505 ms
Total hot run time: 35233 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4147	4032	4133	4032
q2	327	394	311	311
q3	2144	2653	2333	2333
q4	1322	1749	1337	1337
q5	4244	4168	4163	4163
q6	215	170	127	127
q7	1883	1837	1694	1694
q8	2551	2441	2373	2373
q9	6982	6958	7032	6958
q10	2909	3124	2684	2684
q11	595	504	484	484
q12	653	676	549	549
q13	3345	3678	3037	3037
q14	294	282	264	264
q15	555	507	538	507
q16	664	643	616	616
q17	1131	1367	1390	1367
q18	7238	7165	7098	7098
q19	856	843	882	843
q20	1879	1967	1831	1831
q21	4670	4246	4224	4224
q22	1099	1051	980	980
Total cold run time: 49703 ms
Total hot run time: 47812 ms

doris-robot avatar Dec 15 '25 05:12 doris-robot

TPC-DS: Total hot run time: 178359 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cc7389fa6455e6ddf688b026ba5c24d941258248, data reload: false

query5	5445	624	482	482
query6	334	238	210	210
query7	4226	472	281	281
query8	305	243	234	234
query9	4859	2617	2606	2606
query10	557	384	346	346
query11	15254	15310	14581	14581
query12	187	131	117	117
query13	1423	521	392	392
query14	6713	3400	3102	3102
query14_1	2892	3046	3027	3027
query15	217	198	187	187
query16	831	485	465	465
query17	1155	729	616	616
query18	2711	451	359	359
query19	246	243	217	217
query20	123	131	118	118
query21	220	142	124	124
query22	3911	3969	3780	3780
query23	16578	15994	16002	15994
query23_1	16054	16062	16023	16023
query24	6980	1675	1256	1256
query24_1	1282	1270	1274	1270
query25	584	521	458	458
query26	1275	279	170	170
query27	2725	468	320	320
query28	4462	2171	2158	2158
query29	806	580	482	482
query30	318	240	225	225
query31	811	705	625	625
query32	82	77	72	72
query33	538	358	315	315
query34	919	917	558	558
query35	842	856	762	762
query36	870	921	841	841
query37	132	146	89	89
query38	2849	2851	2892	2851
query39	748	811	719	719
query39_1	699	704	723	704
query40	228	145	128	128
query41	68	68	60	60
query42	110	107	110	107
query43	453	440	412	412
query44	1345	764	755	755
query45	195	189	192	189
query46	894	983	620	620
query47	1620	1681	1598	1598
query48	321	336	246	246
query49	630	432	356	356
query50	665	320	212	212
query51	3796	3888	3780	3780
query52	109	112	100	100
query53	333	356	303	303
query54	298	264	261	261
query55	81	83	73	73
query56	298	321	318	318
query57	1149	1139	1090	1090
query58	281	262	264	262
query59	2387	2460	2398	2398
query60	320	317	306	306
query61	199	155	161	155
query62	490	456	433	433
query63	342	310	314	310
query64	4852	1310	1033	1033
query65	4054	4001	3985	3985
query66	1368	446	320	320
query67	15352	14791	14719	14719
query68	8715	1014	726	726
query69	500	354	319	319
query70	1046	960	978	960
query71	384	324	299	299
query72	6067	5003	5132	5003
query73	703	638	317	317
query74	8751	8798	8632	8632
query75	3197	3125	2763	2763
query76	3923	1085	698	698
query77	623	404	304	304
query78	9440	9523	8802	8802
query79	1621	893	642	642
query80	730	644	565	565
query81	538	276	239	239
query82	205	136	108	108
query83	269	268	243	243
query84	256	121	96	96
query85	902	523	459	459
query86	342	294	297	294
query87	3023	3048	2950	2950
query88	3236	2261	2285	2261
query89	472	426	389	389
query90	2311	166	161	161
query91	180	167	144	144
query92	90	71	67	67
query93	1931	937	549	549
query94	481	308	284	284
query95	551	385	310	310
query96	614	473	213	213
query97	2253	2334	2231	2231
query98	216	197	190	190
query99	809	828	740	740
Total cold run time: 257527 ms
Total hot run time: 178359 ms

doris-robot avatar Dec 15 '25 05:12 doris-robot

FE Regression Coverage Report

Increment line coverage 100.00% (3/3) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 15 '25 08:12 hello-stephen

run buildall

morrySnow avatar Dec 15 '25 09:12 morrySnow

TPC-H: Total hot run time: 36638 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c85ab5231b1ace51316a76d1c619d368a8bbb75b, data reload: false

------ Round 1 ----------------------------------
q1	17614	4248	4082	4082
q2	1991	376	297	297
q3	10079	1326	731	731
q4	10220	840	316	316
q5	7322	731	400	400
q6	159	164	135	135
q7	704	711	499	499
q8	9461	736	548	548
q9	25075	5619	5590	5590
q10	9250	4673	4287	4287
q11	531	319	307	307
q12	758	707	586	586
q13	17818	3672	3705	3672
q14	522	418	418	418
q15	594	546	552	546
q16	717	707	665	665
q17	743	846	561	561
q18	8280	8109	7576	7576
q19	1509	1008	658	658
q20	592	520	391	391
q21	4918	4088	4263	4088
q22	382	326	285	285
Total cold run time: 129239 ms
Total hot run time: 36638 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4404	4316	4269	4269
q2	340	404	311	311
q3	2363	3075	2481	2481
q4	1418	1845	1381	1381
q5	4740	4561	4594	4561
q6	219	169	128	128
q7	8102	7967	7872	7872
q8	3007	2802	2772	2772
q9	24376	24335	24274	24274
q10	4264	4682	4293	4293
q11	1029	955	911	911
q12	596	724	584	584
q13	3311	3698	3011	3011
q14	371	393	348	348
q15	553	507	497	497
q16	553	582	565	565
q17	2219	2299	2318	2299
q18	7303	7004	6955	6955
q19	826	827	875	827
q20	1924	1976	1865	1865
q21	10774	10089	10156	10089
q22	596	554	533	533
Total cold run time: 83288 ms
Total hot run time: 80826 ms

doris-robot avatar Dec 15 '25 11:12 doris-robot

FE UT Coverage Report

Increment line coverage 100.00% (4/4) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 15 '25 11:12 hello-stephen

ClickBench: Total hot run time: 26.75 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c85ab5231b1ace51316a76d1c619d368a8bbb75b, data reload: false

query1	0.04	0.04	0.03
query2	0.09	0.03	0.03
query3	0.25	0.07	0.08
query4	1.61	0.11	0.12
query5	0.27	0.25	0.24
query6	1.17	0.63	0.64
query7	0.03	0.02	0.02
query8	0.05	0.04	0.03
query9	0.58	0.51	0.50
query10	0.56	0.55	0.55
query11	0.18	0.10	0.10
query12	0.14	0.10	0.11
query13	0.61	0.61	0.60
query14	0.79	0.78	0.82
query15	0.83	0.79	0.78
query16	0.38	0.41	0.39
query17	1.04	1.05	1.04
query18	0.23	0.21	0.20
query19	1.95	1.71	1.81
query20	0.01	0.00	0.00
query21	15.44	0.30	0.14
query22	4.66	0.06	0.04
query23	16.15	0.28	0.09
query24	1.36	0.29	0.28
query25	0.07	0.04	0.08
query26	0.14	0.14	0.13
query27	0.06	0.07	0.04
query28	3.43	1.26	1.03
query29	12.57	4.04	3.24
query30	0.27	0.13	0.11
query31	2.81	0.63	0.38
query32	3.23	0.56	0.46
query33	2.98	3.03	3.01
query34	16.96	5.34	4.50
query35	4.58	4.52	4.52
query36	0.66	0.49	0.49
query37	0.10	0.06	0.06
query38	0.07	0.04	0.04
query39	0.04	0.02	0.02
query40	0.18	0.14	0.13
query41	0.09	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 96.74 s
Total hot run time: 26.75 s

doris-robot avatar Dec 15 '25 11:12 doris-robot

FE Regression Coverage Report

Increment line coverage 100.00% (4/4) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 15 '25 15:12 hello-stephen