doris icon indicating copy to clipboard operation
doris copied to clipboard

Integration topn filter expr

Open englefly opened this issue 1 year ago • 7 comments

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

englefly avatar May 24 '24 10:05 englefly

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar May 24 '24 10:05 doris-robot

run buildall

englefly avatar May 24 '24 10:05 englefly

TeamCity be ut coverage result: Function Coverage: 35.64% (9018/25303) Line Coverage: 27.31% (74577/273073) Region Coverage: 26.55% (38597/145400) Branch Coverage: 23.41% (19691/84112) Coverage Report: http://coverage.selectdb-in.cc/coverage/f8b33a1fd9b0baa3aab25cb5cc2ad312703bd3f7_f8b33a1fd9b0baa3aab25cb5cc2ad312703bd3f7/report/index.html

doris-robot avatar May 24 '24 11:05 doris-robot

run buildall

englefly avatar May 25 '24 00:05 englefly

run buildall

englefly avatar May 25 '24 01:05 englefly

TPC-H: Total hot run time: 41630 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c6142400b078e15123cd5a9a45a8dc338711b425, data reload: false

------ Round 1 ----------------------------------
q1	17599	4305	4258	4258
q2	2015	187	188	187
q3	10472	1242	1166	1166
q4	10205	849	820	820
q5	7449	2688	2690	2688
q6	243	133	135	133
q7	960	614	626	614
q8	9239	2098	2102	2098
q9	9113	6648	6699	6648
q10	9353	3816	3949	3816
q11	437	248	242	242
q12	435	235	232	232
q13	17257	3221	3271	3221
q14	273	226	227	226
q15	510	463	474	463
q16	471	385	380	380
q17	971	703	754	703
q18	8294	7782	7640	7640
q19	4348	1546	1518	1518
q20	635	310	308	308
q21	5159	4019	3983	3983
q22	345	292	286	286
Total cold run time: 115783 ms
Total hot run time: 41630 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4484	4455	4444	4444
q2	368	275	266	266
q3	3147	2982	2976	2976
q4	1980	1632	1638	1632
q5	5403	5450	5486	5450
q6	217	129	128	128
q7	2232	1812	1838	1812
q8	3228	3405	3404	3404
q9	8545	8669	8723	8669
q10	4045	3772	3861	3772
q11	605	509	497	497
q12	808	646	628	628
q13	17291	3169	3210	3169
q14	296	263	263	263
q15	529	481	476	476
q16	466	415	407	407
q17	1749	1472	1460	1460
q18	7672	8650	7471	7471
q19	1678	1561	1521	1521
q20	1997	1785	1792	1785
q21	8448	4829	4770	4770
q22	562	522	498	498
Total cold run time: 75750 ms
Total hot run time: 55498 ms

doris-robot avatar May 25 '24 01:05 doris-robot

TeamCity be ut coverage result: Function Coverage: 35.64% (9016/25299) Line Coverage: 27.32% (74566/272944) Region Coverage: 26.54% (38571/145350) Branch Coverage: 23.40% (19668/84034) Coverage Report: http://coverage.selectdb-in.cc/coverage/c6142400b078e15123cd5a9a45a8dc338711b425_c6142400b078e15123cd5a9a45a8dc338711b425/report/index.html

doris-robot avatar May 25 '24 02:05 doris-robot

run buildall

englefly avatar May 26 '24 00:05 englefly

TeamCity be ut coverage result: Function Coverage: 35.63% (9015/25299) Line Coverage: 27.32% (74562/272950) Region Coverage: 26.53% (38569/145353) Branch Coverage: 23.40% (19665/84036) Coverage Report: http://coverage.selectdb-in.cc/coverage/bf8e2540ddd2ba448e3e10c49e49167b0487920a_bf8e2540ddd2ba448e3e10c49e49167b0487920a/report/index.html

doris-robot avatar May 26 '24 01:05 doris-robot

TPC-H: Total hot run time: 42035 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bf8e2540ddd2ba448e3e10c49e49167b0487920a, data reload: false

------ Round 1 ----------------------------------
q1	17618	4367	4303	4303
q2	2015	194	190	190
q3	10435	1284	1209	1209
q4	10211	712	793	712
q5	7501	2785	2837	2785
q6	220	133	136	133
q7	959	606	611	606
q8	9214	2143	2109	2109
q9	9453	6764	6730	6730
q10	9870	3884	3819	3819
q11	452	243	236	236
q12	534	232	225	225
q13	18047	3240	3177	3177
q14	261	218	220	218
q15	501	474	476	474
q16	506	421	404	404
q17	990	765	763	763
q18	8479	7791	7785	7785
q19	5402	1580	1513	1513
q20	645	321	321	321
q21	5336	4062	4028	4028
q22	363	295	301	295
Total cold run time: 119012 ms
Total hot run time: 42035 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4589	4484	4393	4393
q2	386	263	276	263
q3	3176	2979	2859	2859
q4	1905	1627	1606	1606
q5	5461	5495	5488	5488
q6	215	125	125	125
q7	2200	1870	1860	1860
q8	3251	3434	3370	3370
q9	8623	8706	8661	8661
q10	4027	3755	3862	3755
q11	597	500	498	498
q12	802	643	619	619
q13	17153	3145	3133	3133
q14	314	282	258	258
q15	520	488	492	488
q16	496	472	434	434
q17	1782	1497	1450	1450
q18	7804	7581	7397	7397
q19	1667	1495	1541	1495
q20	2052	1791	1794	1791
q21	13165	4759	4730	4730
q22	568	492	507	492
Total cold run time: 80753 ms
Total hot run time: 55165 ms

doris-robot avatar May 26 '24 01:05 doris-robot

run buildall

englefly avatar May 26 '24 06:05 englefly

TeamCity be ut coverage result: Function Coverage: 35.64% (9016/25299) Line Coverage: 27.32% (74567/272962) Region Coverage: 26.54% (38577/145375) Branch Coverage: 23.40% (19666/84054) Coverage Report: http://coverage.selectdb-in.cc/coverage/47946d488130d71e45badb179c1ccb277554e0a5_47946d488130d71e45badb179c1ccb277554e0a5/report/index.html

doris-robot avatar May 26 '24 07:05 doris-robot

TPC-H: Total hot run time: 41653 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 47946d488130d71e45badb179c1ccb277554e0a5, data reload: false

------ Round 1 ----------------------------------
q1	17589	4252	4225	4225
q2	2016	193	185	185
q3	10479	1238	1156	1156
q4	10217	905	817	817
q5	7508	2677	2721	2677
q6	234	133	136	133
q7	952	609	615	609
q8	9230	2131	2082	2082
q9	9421	6668	6655	6655
q10	9811	3908	3853	3853
q11	431	231	240	231
q12	451	228	230	228
q13	17238	3168	3224	3168
q14	277	237	220	220
q15	529	466	478	466
q16	464	383	372	372
q17	968	743	727	727
q18	8444	7756	7814	7756
q19	3304	1511	1521	1511
q20	651	309	306	306
q21	5089	3994	4100	3994
q22	359	282	283	282
Total cold run time: 115662 ms
Total hot run time: 41653 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4658	4372	4339	4339
q2	390	273	271	271
q3	3146	2914	2877	2877
q4	1900	1604	1563	1563
q5	5489	5479	5509	5479
q6	212	124	132	124
q7	2168	1863	1808	1808
q8	3247	3374	3361	3361
q9	8643	8676	8637	8637
q10	3980	3662	3773	3662
q11	607	488	498	488
q12	789	606	640	606
q13	17028	3195	3172	3172
q14	287	288	271	271
q15	552	479	485	479
q16	527	447	457	447
q17	1825	1473	1454	1454
q18	7630	7523	7726	7523
q19	1646	1542	1551	1542
q20	2012	1789	1795	1789
q21	4765	4748	4634	4634
q22	573	492	488	488
Total cold run time: 72074 ms
Total hot run time: 55014 ms

doris-robot avatar May 26 '24 07:05 doris-robot