doris icon indicating copy to clipboard operation
doris copied to clipboard

[chore](analytic) remove useless partition and order eq expr in thrift

Open morrySnow opened this issue 2 weeks ago • 17 comments

Check List (For Author)

  • Test

    • [ ] Regression test
    • [ ] Unit Test
    • [ ] Manual test (add detailed scripts or steps below)
    • [x] No need to test or manual test. Explain why:
      • [ ] This is a refactor/code format and no logic has been changed.
      • [x] Previous test can cover this change.
      • [ ] No code files have been changed.
      • [ ] Other reason
  • Behavior changed:

    • [x] No.
    • [ ] Yes.
  • Does this need documentation?

    • [x] No.
    • [ ] Yes.

Check List (For Reviewer who merge this PR)

  • [ ] Confirm the release note
  • [ ] Confirm test cases
  • [ ] Confirm document
  • [ ] Add branch pick label

morrySnow avatar Dec 11 '25 04:12 morrySnow

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

hello-stephen avatar Dec 11 '25 04:12 hello-stephen

run buildall

morrySnow avatar Dec 11 '25 04:12 morrySnow

TPC-H: Total hot run time: 35206 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9dea52468f41f85c113527187bc8996a5e98a5e8, data reload: false

------ Round 1 ----------------------------------
q1	17648	4349	4111	4111
q2	2033	348	243	243
q3	10177	1319	757	757
q4	10216	830	314	314
q5	7487	2160	1906	1906
q6	192	171	141	141
q7	1005	873	702	702
q8	9364	1410	1184	1184
q9	7255	5393	5262	5262
q10	6855	2420	1994	1994
q11	535	325	292	292
q12	725	724	564	564
q13	17803	3675	3022	3022
q14	295	294	278	278
q15	597	528	512	512
q16	940	904	875	875
q17	706	828	522	522
q18	7561	7021	7064	7021
q19	1376	977	616	616
q20	381	357	239	239
q21	4233	3932	3692	3692
q22	1042	1002	959	959
Total cold run time: 108426 ms
Total hot run time: 35206 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4188	4073	4104	4073
q2	327	382	326	326
q3	2101	2667	2246	2246
q4	1312	1765	1264	1264
q5	4240	4771	4658	4658
q6	229	177	141	141
q7	2147	1996	1764	1764
q8	2698	2568	2614	2568
q9	7504	7514	7459	7459
q10	3136	3279	2789	2789
q11	604	549	541	541
q12	735	782	606	606
q13	3498	3901	3449	3449
q14	287	294	273	273
q15	549	523	516	516
q16	886	919	851	851
q17	1329	1591	1452	1452
q18	7908	7630	7559	7559
q19	875	900	897	897
q20	1989	1998	1813	1813
q21	4643	4268	4251	4251
q22	1106	1024	978	978
Total cold run time: 52291 ms
Total hot run time: 50474 ms

doris-robot avatar Dec 11 '25 05:12 doris-robot

TPC-DS: Total hot run time: 181421 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9dea52468f41f85c113527187bc8996a5e98a5e8, data reload: false

query5	5016	608	464	464
query6	332	240	209	209
query7	4211	469	270	270
query8	309	254	245	245
query9	8786	2561	2577	2561
query10	518	379	327	327
query11	15441	14789	14992	14789
query12	186	118	112	112
query13	1272	508	381	381
query14	6206	3272	3099	3099
query14_1	2908	2901	2992	2901
query15	217	198	177	177
query16	872	489	442	442
query17	1146	729	621	621
query18	2588	449	359	359
query19	239	236	216	216
query20	125	115	117	115
query21	217	141	120	120
query22	3903	3915	3880	3880
query23	17117	16096	15990	15990
query23_1	16256	16090	16047	16047
query24	7277	1639	1226	1226
query24_1	1255	1235	1258	1235
query25	562	465	421	421
query26	1247	263	160	160
query27	2757	458	308	308
query28	4454	2154	2133	2133
query29	813	551	443	443
query30	311	250	215	215
query31	825	713	625	625
query32	78	81	68	68
query33	564	344	298	298
query34	902	889	555	555
query35	788	831	725	725
query36	865	913	853	853
query37	134	96	76	76
query38	3852	3910	3885	3885
query39	761	741	723	723
query39_1	704	709	686	686
query40	223	138	119	119
query41	67	67	61	61
query42	111	110	108	108
query43	445	444	402	402
query44	1346	775	761	761
query45	195	204	184	184
query46	890	984	612	612
query47	1635	1718	1618	1618
query48	324	347	246	246
query49	648	456	354	354
query50	664	305	226	226
query51	3848	3827	3832	3827
query52	109	116	103	103
query53	340	355	297	297
query54	319	268	251	251
query55	81	76	78	76
query56	295	292	315	292
query57	1144	1139	1060	1060
query58	264	251	255	251
query59	2373	2388	2307	2307
query60	317	306	291	291
query61	181	160	155	155
query62	714	680	639	639
query63	333	303	314	303
query64	4977	1333	1079	1079
query65	3989	3952	3951	3951
query66	1444	463	339	339
query67	15150	15018	14711	14711
query68	4672	1037	755	755
query69	511	353	332	332
query70	1094	1028	1004	1004
query71	379	311	293	293
query72	6294	5060	5010	5010
query73	696	624	310	310
query74	8759	8863	8560	8560
query75	3580	3588	3190	3190
query76	3818	1147	766	766
query77	519	406	296	296
query78	9554	9607	8889	8889
query79	1738	867	627	627
query80	946	654	545	545
query81	531	269	232	232
query82	422	126	109	109
query83	262	250	241	241
query84	264	119	99	99
query85	944	497	476	476
query86	424	298	286	286
query87	4129	4036	3947	3947
query88	3377	2289	2299	2289
query89	473	421	405	405
query90	2150	164	159	159
query91	175	165	143	143
query92	79	69	67	67
query93	2074	924	568	568
query94	529	298	284	284
query95	584	376	308	308
query96	603	471	210	210
query97	2593	2638	2572	2572
query98	211	202	191	191
query99	1289	1305	1184	1184
Total cold run time: 262445 ms
Total hot run time: 181421 ms

doris-robot avatar Dec 11 '25 05:12 doris-robot

ClickBench: Total hot run time: 27.19 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9dea52468f41f85c113527187bc8996a5e98a5e8, data reload: false

query1	0.05	0.04	0.04
query2	0.09	0.05	0.05
query3	0.25	0.08	0.08
query4	1.60	0.11	0.12
query5	0.28	0.25	0.26
query6	1.17	0.64	0.63
query7	0.03	0.02	0.03
query8	0.06	0.04	0.05
query9	0.58	0.51	0.50
query10	0.56	0.56	0.55
query11	0.17	0.11	0.11
query12	0.15	0.12	0.12
query13	0.64	0.60	0.60
query14	0.98	0.98	0.99
query15	0.82	0.80	0.80
query16	0.42	0.39	0.40
query17	0.98	1.06	1.02
query18	0.23	0.22	0.22
query19	1.87	1.73	1.86
query20	0.02	0.01	0.01
query21	15.46	0.30	0.14
query22	5.02	0.05	0.05
query23	16.06	0.28	0.11
query24	1.89	0.57	0.34
query25	0.08	0.06	0.05
query26	0.14	0.14	0.12
query27	0.04	0.05	0.04
query28	3.34	1.20	1.02
query29	12.62	4.07	3.19
query30	0.27	0.14	0.12
query31	2.81	0.62	0.39
query32	3.23	0.55	0.46
query33	2.96	3.03	3.05
query34	16.66	5.17	4.52
query35	4.58	4.55	4.53
query36	0.67	0.52	0.49
query37	0.11	0.07	0.06
query38	0.07	0.05	0.04
query39	0.04	0.03	0.03
query40	0.17	0.14	0.13
query41	0.08	0.03	0.02
query42	0.05	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 97.34 s
Total hot run time: 27.19 s

doris-robot avatar Dec 11 '25 05:12 doris-robot

FE Regression Coverage Report

Increment line coverage 100.00% (1/1) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 11 '25 09:12 hello-stephen

run buildall

morrySnow avatar Dec 11 '25 10:12 morrySnow

Cloud UT Coverage Report

Increment line coverage :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 79.83% (1730/2167)
Line Coverage 65.86% (30607/46476)
Region Coverage 66.57% (15267/22934)
Branch Coverage 56.91% (8119/14266)

hello-stephen avatar Dec 11 '25 10:12 hello-stephen

TPC-H: Total hot run time: 36155 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 439618bcc62d8a49cae6d8a1c21ce3aa465a67e1, data reload: false

------ Round 1 ----------------------------------
q1	16497	4317	4111	4111
q2	2068	350	236	236
q3	9713	1404	766	766
q4	9772	919	316	316
q5	7289	2198	2051	2051
q6	193	173	136	136
q7	1009	851	716	716
q8	9060	1606	1311	1311
q9	7212	5444	5433	5433
q10	6809	2419	2007	2007
q11	541	335	306	306
q12	657	712	565	565
q13	17402	3696	3048	3048
q14	301	310	273	273
q15	582	518	514	514
q16	945	932	892	892
q17	708	874	561	561
q18	7696	7168	7138	7138
q19	1096	990	645	645
q20	415	374	246	246
q21	4437	4091	3900	3900
q22	1060	984	1001	984
Total cold run time: 105462 ms
Total hot run time: 36155 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4174	4135	4118	4118
q2	330	415	326	326
q3	2156	2712	2349	2349
q4	1341	1760	1326	1326
q5	4299	4666	4789	4666
q6	231	177	132	132
q7	2089	2050	1841	1841
q8	2714	2585	2648	2585
q9	7923	7428	7615	7428
q10	3101	3357	2770	2770
q11	611	527	491	491
q12	687	737	613	613
q13	3616	3972	3435	3435
q14	296	298	300	298
q15	544	518	516	516
q16	903	919	875	875
q17	1238	1741	1439	1439
q18	7836	7602	7669	7602
q19	951	879	934	879
q20	2125	2103	1875	1875
q21	5073	4711	4568	4568
q22	1075	1007	1005	1005
Total cold run time: 53313 ms
Total hot run time: 51137 ms

doris-robot avatar Dec 11 '25 10:12 doris-robot

TPC-DS: Total hot run time: 181308 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 439618bcc62d8a49cae6d8a1c21ce3aa465a67e1, data reload: false

query5	4866	627	493	493
query6	340	249	250	249
query7	4237	475	283	283
query8	319	251	252	251
query9	8770	2587	2555	2555
query10	498	380	330	330
query11	15480	14748	14585	14585
query12	182	115	117	115
query13	1321	538	411	411
query14	5918	3296	3026	3026
query14_1	2896	2863	2910	2863
query15	211	200	188	188
query16	896	476	421	421
query17	1107	685	588	588
query18	2563	435	345	345
query19	230	222	207	207
query20	120	113	114	113
query21	215	139	119	119
query22	3958	3902	3878	3878
query23	16519	16060	16057	16057
query23_1	15807	16137	16013	16013
query24	7057	1642	1244	1244
query24_1	1245	1243	1264	1243
query25	547	479	461	461
query26	1260	290	173	173
query27	2714	491	316	316
query28	4299	2208	2137	2137
query29	777	557	438	438
query30	316	242	215	215
query31	822	718	621	621
query32	81	69	70	69
query33	517	331	297	297
query34	899	921	541	541
query35	799	796	722	722
query36	844	904	815	815
query37	129	92	78	78
query38	3975	3951	3845	3845
query39	764	736	707	707
query39_1	705	712	700	700
query40	225	143	121	121
query41	70	63	66	63
query42	109	120	110	110
query43	424	432	400	400
query44	1322	767	742	742
query45	191	189	179	179
query46	896	967	633	633
query47	1628	1701	1589	1589
query48	320	346	249	249
query49	639	464	357	357
query50	662	309	222	222
query51	3782	3873	3774	3774
query52	109	112	97	97
query53	349	351	290	290
query54	288	259	271	259
query55	77	77	71	71
query56	334	306	308	306
query57	1145	1123	1081	1081
query58	258	257	247	247
query59	2471	2481	2394	2394
query60	323	315	304	304
query61	159	160	161	160
query62	707	689	620	620
query63	334	288	306	288
query64	4688	1322	1029	1029
query65	4013	3936	3948	3936
query66	1422	458	317	317
query67	15280	15039	14805	14805
query68	2821	1050	801	801
query69	451	372	325	325
query70	1062	997	954	954
query71	327	330	300	300
query72	6197	4871	4869	4869
query73	486	563	312	312
query74	8719	8876	8573	8573
query75	3501	3556	3192	3192
query76	2544	1140	750	750
query77	361	392	308	308
query78	9531	9730	8801	8801
query79	1060	907	606	606
query80	714	643	566	566
query81	485	272	243	243
query82	624	136	109	109
query83	266	263	249	249
query84	260	127	96	96
query85	883	534	503	503
query86	315	306	282	282
query87	3968	3996	4008	3996
query88	3286	2277	2276	2276
query89	461	427	394	394
query90	1979	167	154	154
query91	177	171	149	149
query92	76	69	68	68
query93	989	922	585	585
query94	366	278	274	274
query95	562	335	317	317
query96	613	481	220	220
query97	2616	2639	2572	2572
query98	212	200	192	192
query99	1348	1307	1247	1247
Total cold run time: 253534 ms
Total hot run time: 181308 ms

doris-robot avatar Dec 11 '25 10:12 doris-robot

ClickBench: Total hot run time: 28.23 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 439618bcc62d8a49cae6d8a1c21ce3aa465a67e1, data reload: false

query1	0.06	0.05	0.05
query2	0.10	0.04	0.04
query3	0.25	0.08	0.09
query4	1.61	0.11	0.11
query5	0.29	0.25	0.26
query6	1.19	0.64	0.63
query7	0.03	0.02	0.02
query8	0.06	0.04	0.05
query9	0.58	0.51	0.51
query10	0.55	0.55	0.55
query11	0.16	0.11	0.12
query12	0.15	0.12	0.12
query13	0.62	0.60	0.61
query14	0.99	0.98	0.99
query15	0.81	0.80	0.81
query16	0.39	0.40	0.38
query17	1.01	1.00	1.01
query18	0.22	0.22	0.21
query19	1.88	1.88	1.85
query20	0.02	0.01	0.01
query21	15.46	0.33	0.15
query22	4.71	0.06	0.04
query23	16.01	0.28	0.10
query24	2.29	0.54	0.87
query25	0.07	0.08	0.06
query26	0.17	0.14	0.13
query27	0.05	0.06	0.05
query28	5.52	1.22	1.03
query29	12.58	4.00	3.29
query30	0.31	0.14	0.12
query31	2.82	0.66	0.40
query32	3.22	0.55	0.46
query33	3.03	2.99	3.13
query34	16.69	5.14	4.55
query35	4.57	5.32	5.09
query36	0.69	0.54	0.53
query37	0.11	0.07	0.07
query38	0.07	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.16	0.14
query41	0.09	0.03	0.04
query42	0.05	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 99.73 s
Total hot run time: 28.23 s

doris-robot avatar Dec 11 '25 10:12 doris-robot

FE UT Coverage Report

Increment line coverage 100.00% (1/1) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 11 '25 11:12 hello-stephen

BE UT Coverage Report

Increment line coverage :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 53.43% (18826/35237)
Line Coverage 39.18% (174120/444386)
Region Coverage 33.83% (134833/398591)
Branch Coverage 34.77% (58021/166879)

hello-stephen avatar Dec 11 '25 11:12 hello-stephen

BE Regression && UT Coverage Report

Increment line coverage 100% (0/0) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 72.32% (24974/34534)
Line Coverage 59.09% (262302/443881)
Region Coverage 54.05% (217999/403307)
Branch Coverage 55.63% (93328/167752)

hello-stephen avatar Dec 11 '25 12:12 hello-stephen

FE Regression Coverage Report

Increment line coverage 100.00% (1/1) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 11 '25 13:12 hello-stephen

BE Regression && UT Coverage Report

Increment line coverage 100% (0/0) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 72.32% (24976/34534)
Line Coverage 59.10% (262316/443881)
Region Coverage 54.08% (218089/403307)
Branch Coverage 55.63% (93324/167752)

hello-stephen avatar Dec 11 '25 18:12 hello-stephen

FE Regression Coverage Report

Increment line coverage 100.00% (1/1) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 11 '25 18:12 hello-stephen

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar Dec 12 '25 02:12 github-actions[bot]

PR approved by anyone and no changes requested.

github-actions[bot] avatar Dec 12 '25 02:12 github-actions[bot]