doris icon indicating copy to clipboard operation
doris copied to clipboard

[opt](thrift)update thrift to support pushing limit to local Agg

Open englefly opened this issue 1 year ago • 8 comments

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

englefly avatar May 22 '24 08:05 englefly

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar May 22 '24 08:05 doris-robot

run buildall

englefly avatar May 22 '24 08:05 englefly

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 22 '24 08:05 github-actions[bot]

run buildall

englefly avatar May 22 '24 08:05 englefly

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 22 '24 09:05 github-actions[bot]

TPC-H: Total hot run time: 42085 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1b85187b22fcb61c2708c606ce3be399c8e9fb58, data reload: false

------ Round 1 ----------------------------------
q1	17598	4404	4295	4295
q2	2026	191	191	191
q3	10460	1202	1194	1194
q4	10197	809	727	727
q5	7487	2729	2750	2729
q6	223	132	139	132
q7	968	627	631	627
q8	9217	2172	2143	2143
q9	9068	6759	6683	6683
q10	9361	3929	3857	3857
q11	436	252	246	246
q12	571	236	236	236
q13	17262	3213	3312	3213
q14	273	224	228	224
q15	521	458	487	458
q16	478	384	386	384
q17	1018	649	725	649
q18	8511	7872	7845	7845
q19	6686	1570	1507	1507
q20	638	325	316	316
q21	5289	4144	4171	4144
q22	356	285	290	285
Total cold run time: 118644 ms
Total hot run time: 42085 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4618	4436	4426	4426
q2	365	278	274	274
q3	3169	2973	2872	2872
q4	1896	1646	1610	1610
q5	5592	5528	5493	5493
q6	215	127	130	127
q7	2229	1822	1834	1822
q8	3284	3435	3430	3430
q9	8665	8750	8709	8709
q10	3993	3784	3838	3784
q11	612	498	504	498
q12	818	615	641	615
q13	17083	3183	3207	3183
q14	326	295	260	260
q15	534	479	490	479
q16	503	438	431	431
q17	1816	1527	1482	1482
q18	7781	7732	7495	7495
q19	1682	1592	1614	1592
q20	1999	1803	1805	1803
q21	9239	4789	4811	4789
q22	556	492	488	488
Total cold run time: 76975 ms
Total hot run time: 55662 ms

doris-robot avatar May 22 '24 10:05 doris-robot

TPC-DS: Total hot run time: 168264 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1b85187b22fcb61c2708c606ce3be399c8e9fb58, data reload: false

query1	918	384	377	377
query2	6426	2322	2399	2322
query3	6645	202	201	201
query4	20732	17313	17397	17313
query5	4134	416	414	414
query6	265	152	151	151
query7	4585	293	285	285
query8	243	191	181	181
query9	8603	2371	2350	2350
query10	445	298	250	250
query11	10773	10135	10214	10135
query12	139	90	88	88
query13	1639	359	356	356
query14	10260	7484	6698	6698
query15	222	170	168	168
query16	7795	264	250	250
query17	1785	522	531	522
query18	1867	257	268	257
query19	208	152	155	152
query20	100	90	87	87
query21	190	127	127	127
query22	4313	4070	3874	3874
query23	33595	32865	32807	32807
query24	6726	2863	2757	2757
query25	524	353	358	353
query26	706	175	155	155
query27	1977	303	319	303
query28	3827	2027	2037	2027
query29	857	591	595	591
query30	239	172	173	172
query31	1027	791	739	739
query32	97	54	52	52
query33	500	269	256	256
query34	852	469	471	469
query35	684	620	584	584
query36	1019	933	897	897
query37	108	68	72	68
query38	2901	2860	2789	2789
query39	819	810	795	795
query40	204	130	123	123
query41	49	48	47	47
query42	102	96	102	96
query43	552	540	567	540
query44	1041	722	743	722
query45	191	165	159	159
query46	1065	700	712	700
query47	1878	1778	1809	1778
query48	366	296	330	296
query49	771	375	385	375
query50	767	384	384	384
query51	6922	6802	6810	6802
query52	98	94	89	89
query53	348	287	278	278
query54	529	427	421	421
query55	71	70	70	70
query56	258	237	239	237
query57	1122	1047	1035	1035
query58	221	203	208	203
query59	3294	3063	3013	3013
query60	285	285	255	255
query61	87	88	102	88
query62	556	446	448	446
query63	303	278	278	278
query64	8411	2210	1800	1800
query65	3145	3077	3087	3077
query66	793	326	315	315
query67	15344	14772	14860	14772
query68	4579	520	518	518
query69	433	261	264	261
query70	1141	1052	1128	1052
query71	385	266	262	262
query72	7423	2691	2531	2531
query73	712	316	313	313
query74	6077	5632	5692	5632
query75	3297	2611	2577	2577
query76	2195	1017	894	894
query77	399	266	279	266
query78	10200	10076	9678	9678
query79	2157	506	509	506
query80	1007	454	485	454
query81	510	249	242	242
query82	617	94	94	94
query83	232	170	170	170
query84	251	84	83	83
query85	1337	263	257	257
query86	535	295	304	295
query87	3367	3142	3155	3142
query88	3891	2317	2317	2317
query89	475	375	364	364
query90	2029	184	184	184
query91	121	95	90	90
query92	57	46	50	46
query93	2101	507	487	487
query94	1212	186	178	178
query95	396	300	303	300
query96	588	277	259	259
query97	3169	3022	2993	2993
query98	243	226	213	213
query99	1123	835	841	835
Total cold run time: 259777 ms
Total hot run time: 168264 ms

doris-robot avatar May 22 '24 10:05 doris-robot

ClickBench: Total hot run time: 30.3 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1b85187b22fcb61c2708c606ce3be399c8e9fb58, data reload: false

query1	0.05	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.06
query4	1.67	0.09	0.10
query5	0.50	0.50	0.51
query6	1.13	0.72	0.72
query7	0.02	0.01	0.01
query8	0.04	0.04	0.04
query9	0.55	0.50	0.49
query10	0.54	0.54	0.54
query11	0.15	0.12	0.12
query12	0.16	0.12	0.12
query13	0.60	0.59	0.59
query14	0.77	0.77	0.75
query15	0.82	0.81	0.80
query16	0.35	0.35	0.35
query17	0.99	1.04	1.01
query18	0.22	0.25	0.24
query19	1.86	1.69	1.76
query20	0.01	0.01	0.01
query21	15.65	0.68	0.64
query22	4.61	7.05	1.71
query23	18.30	1.46	1.27
query24	1.56	0.37	0.22
query25	0.13	0.10	0.09
query26	0.26	0.17	0.17
query27	0.09	0.08	0.07
query28	13.30	1.03	0.99
query29	13.79	3.34	3.26
query30	0.24	0.06	0.05
query31	2.86	0.41	0.39
query32	3.25	0.48	0.46
query33	2.87	2.93	2.91
query34	17.18	4.40	4.40
query35	4.46	4.46	4.67
query36	0.65	0.46	0.47
query37	0.19	0.15	0.16
query38	0.14	0.14	0.14
query39	0.04	0.04	0.03
query40	0.17	0.13	0.14
query41	0.09	0.04	0.04
query42	0.05	0.05	0.04
query43	0.04	0.03	0.04
Total cold run time: 110.66 s
Total hot run time: 30.3 s

doris-robot avatar May 22 '24 10:05 doris-robot

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar May 23 '24 03:05 github-actions[bot]

PR approved by anyone and no changes requested.

github-actions[bot] avatar May 23 '24 03:05 github-actions[bot]