doris icon indicating copy to clipboard operation
doris copied to clipboard

[improve](varbinary) support varbinary type with topn runtime filter

Open zhangstar333 opened this issue 1 month ago • 55 comments

What problem does this PR solve?

Problem Summary: support varbinary with topn runtime filter eg: order by binary_col limit n and temp forbid varbinary type at: group by key, join key, comparison predicate in FE part.

Release note

None

Check List (For Author)

  • Test

    • [x] Regression test
    • [ ] Unit Test
    • [ ] Manual test (add detailed scripts or steps below)
    • [ ] No need to test or manual test. Explain why:
      • [ ] This is a refactor/code format and no logic has been changed.
      • [ ] Previous test can cover this change.
      • [ ] No code files have been changed.
      • [ ] Other reason
  • Behavior changed:

    • [x] No.
    • [ ] Yes.
  • Does this need documentation?

    • [x] No.
    • [ ] Yes.

Check List (For Reviewer who merge this PR)

  • [ ] Confirm the release note
  • [ ] Confirm test cases
  • [ ] Confirm document
  • [ ] Add branch pick label

zhangstar333 avatar Dec 04 '25 10:12 zhangstar333

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

hello-stephen avatar Dec 04 '25 10:12 hello-stephen

run buildall

zhangstar333 avatar Dec 04 '25 10:12 zhangstar333

TPC-H: Total hot run time: 34631 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1b2141b616ee6202ca5e8f0c64f3cffc6b5d3897, data reload: false

------ Round 1 ----------------------------------
q1	17621	5139	4936	4936
q2	2054	306	193	193
q3	10306	1337	737	737
q4	10195	788	318	318
q5	7524	2504	2158	2158
q6	196	177	139	139
q7	1008	785	651	651
q8	9357	1452	1104	1104
q9	7163	5329	5381	5329
q10	6877	2207	1764	1764
q11	527	326	293	293
q12	404	371	234	234
q13	17797	3681	3107	3107
q14	238	262	212	212
q15	598	521	522	521
q16	899	888	825	825
q17	710	793	557	557
q18	7852	7144	7176	7144
q19	1103	972	620	620
q20	380	356	225	225
q21	4081	3379	2599	2599
q22	1043	1001	965	965
Total cold run time: 107933 ms
Total hot run time: 34631 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4973	5013	4935	4935
q2	332	405	333	333
q3	2145	2704	2329	2329
q4	1395	1800	1320	1320
q5	4255	4545	4587	4545
q6	230	191	139	139
q7	2139	2032	1823	1823
q8	2663	2527	2698	2527
q9	7682	7455	7574	7455
q10	3061	3286	2845	2845
q11	596	525	494	494
q12	704	764	614	614
q13	3596	4009	3205	3205
q14	291	320	285	285
q15	547	506	526	506
q16	883	922	891	891
q17	1229	1509	1497	1497
q18	7977	7676	7573	7573
q19	945	905	922	905
q20	1980	1980	1823	1823
q21	4641	4279	4162	4162
q22	1119	1050	998	998
Total cold run time: 53383 ms
Total hot run time: 51204 ms

doris-robot avatar Dec 04 '25 12:12 doris-robot

TPC-DS: Total hot run time: 180224 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1b2141b616ee6202ca5e8f0c64f3cffc6b5d3897, data reload: false

query5	4609	645	506	506
query6	359	235	209	209
query7	4664	480	273	273
query8	301	257	246	246
query9	8748	2661	2691	2661
query10	546	331	289	289
query11	15307	15048	14533	14533
query12	196	119	118	118
query13	1697	491	378	378
query14	6495	3301	3098	3098
query14_1	2904	2944	2888	2888
query15	211	194	188	188
query16	7624	499	474	474
query17	1250	738	622	622
query18	2090	440	352	352
query19	235	194	170	170
query20	135	120	125	120
query21	220	140	117	117
query22	3946	4123	3916	3916
query23	16714	16214	16102	16102
query23_1	16260	16020	16069	16020
query24	7184	1653	1217	1217
query24_1	1220	1211	1257	1211
query25	661	514	451	451
query26	1256	284	178	178
query27	2894	479	316	316
query28	4377	2206	2182	2182
query29	839	594	477	477
query30	314	243	215	215
query31	839	688	622	622
query32	88	71	72	71
query33	721	360	311	311
query34	924	901	550	550
query35	796	829	724	724
query36	897	920	846	846
query37	122	90	80	80
query38	3858	3872	3835	3835
query39	771	729	733	729
query39_1	710	705	697	697
query40	222	129	117	117
query41	65	63	63	63
query42	123	100	98	98
query43	443	421	403	403
query44	1340	774	763	763
query45	198	197	184	184
query46	909	989	612	612
query47	1691	1752	1635	1635
query48	396	329	232	232
query49	787	444	354	354
query50	698	319	239	239
query51	3859	3856	3981	3856
query52	119	97	84	84
query53	225	228	181	181
query54	318	258	253	253
query55	98	78	76	76
query56	329	298	287	287
query57	1176	1153	1125	1125
query58	298	265	253	253
query59	2412	2462	2336	2336
query60	364	315	306	306
query61	158	157	159	157
query62	796	676	636	636
query63	234	182	183	182
query64	4535	1164	905	905
query65	4021	3978	3939	3939
query66	1203	476	339	339
query67	15372	15190	14956	14956
query68	8247	942	666	666
query69	520	311	270	270
query70	1121	993	978	978
query71	456	296	272	272
query72	6164	4946	4990	4946
query73	693	588	300	300
query74	8819	8973	8607	8607
query75	3576	3023	2555	2555
query76	3543	1150	753	753
query77	816	408	302	302
query78	9450	9649	8862	8862
query79	1935	813	594	594
query80	659	554	461	461
query81	517	274	243	243
query82	497	135	105	105
query83	277	273	251	251
query84	265	108	98	98
query85	994	501	463	463
query86	387	325	297	297
query87	4010	4042	3979	3979
query88	4219	2158	2152	2152
query89	413	332	283	283
query90	2010	162	157	157
query91	172	164	144	144
query92	87	66	67	66
query93	1897	1056	675	675
query94	771	304	275	275
query95	582	372	334	334
query96	559	496	219	219
query97	2633	2689	2596	2596
query98	250	198	200	198
query99	1340	1317	1196	1196
Total cold run time: 273069 ms
Total hot run time: 180224 ms

doris-robot avatar Dec 04 '25 12:12 doris-robot

ClickBench: Total hot run time: 27.26 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1b2141b616ee6202ca5e8f0c64f3cffc6b5d3897, data reload: false

query1	0.04	0.05	0.04
query2	0.10	0.05	0.04
query3	0.25	0.08	0.08
query4	1.61	0.11	0.11
query5	0.27	0.25	0.26
query6	1.14	0.64	0.64
query7	0.03	0.03	0.02
query8	0.05	0.04	0.04
query9	0.58	0.49	0.50
query10	0.56	0.57	0.55
query11	0.16	0.11	0.11
query12	0.14	0.12	0.12
query13	0.63	0.60	0.60
query14	1.03	0.98	0.99
query15	0.82	0.81	0.82
query16	0.38	0.40	0.41
query17	1.05	1.06	1.00
query18	0.24	0.22	0.22
query19	1.93	1.83	1.77
query20	0.01	0.02	0.01
query21	15.43	0.29	0.14
query22	4.78	0.05	0.05
query23	15.95	0.27	0.11
query24	1.36	0.47	0.20
query25	0.09	0.08	0.05
query26	0.15	0.13	0.14
query27	0.05	0.06	0.08
query28	3.96	1.21	1.02
query29	12.64	4.03	3.23
query30	0.28	0.14	0.11
query31	2.82	0.63	0.41
query32	3.24	0.56	0.47
query33	2.99	3.10	3.07
query34	16.76	5.16	4.56
query35	4.58	4.56	4.52
query36	0.68	0.49	0.49
query37	0.10	0.07	0.07
query38	0.07	0.04	0.04
query39	0.05	0.03	0.03
query40	0.16	0.14	0.13
query41	0.09	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.03	0.03
Total cold run time: 97.33 s
Total hot run time: 27.26 s

doris-robot avatar Dec 04 '25 12:12 doris-robot

BE UT Coverage Report

Increment line coverage 12.79% (11/86) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 53.32% (18637/34955)
Line Coverage 39.00% (172081/441270)
Region Coverage 33.63% (133326/396466)
Branch Coverage 34.57% (57344/165898)

doris-robot avatar Dec 04 '25 13:12 doris-robot

run buildall

zhangstar333 avatar Dec 04 '25 14:12 zhangstar333

TPC-H: Total hot run time: 34323 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1fc92d856f8a3304e11f18c747bea564a32b60d3, data reload: false

------ Round 1 ----------------------------------
q1	17669	5117	4926	4926
q2	2076	323	197	197
q3	10215	1329	748	748
q4	10224	840	327	327
q5	7521	2479	2119	2119
q6	183	175	143	143
q7	979	790	634	634
q8	9354	1417	1110	1110
q9	7330	5362	5358	5358
q10	6876	2222	1825	1825
q11	523	311	295	295
q12	392	377	227	227
q13	17814	3696	3050	3050
q14	237	241	211	211
q15	597	518	514	514
q16	880	861	814	814
q17	697	789	555	555
q18	7730	7268	6977	6977
q19	1118	988	599	599
q20	375	353	223	223
q21	4033	3397	2525	2525
q22	1059	1001	946	946
Total cold run time: 107882 ms
Total hot run time: 34323 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5030	4984	4974	4974
q2	319	414	330	330
q3	2176	2699	2267	2267
q4	1349	1760	1308	1308
q5	4252	4532	4559	4532
q6	230	184	133	133
q7	2120	1991	1820	1820
q8	2742	2562	2531	2531
q9	7597	7604	7520	7520
q10	3092	3342	2824	2824
q11	603	522	508	508
q12	672	731	616	616
q13	3611	3977	3275	3275
q14	308	307	310	307
q15	573	521	507	507
q16	930	947	884	884
q17	1213	1514	1462	1462
q18	8054	7630	7760	7630
q19	932	881	907	881
q20	2005	2094	1802	1802
q21	4615	4389	4105	4105
q22	1119	1062	1004	1004
Total cold run time: 53542 ms
Total hot run time: 51220 ms

doris-robot avatar Dec 04 '25 16:12 doris-robot

TPC-DS: Total hot run time: 180612 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1fc92d856f8a3304e11f18c747bea564a32b60d3, data reload: false

query5	4621	632	497	497
query6	339	227	208	208
query7	4651	481	279	279
query8	325	260	236	236
query9	8755	2669	2663	2663
query10	544	331	285	285
query11	15141	14790	14970	14790
query12	177	123	116	116
query13	1701	498	388	388
query14	5905	3326	3044	3044
query14_1	2962	2984	2941	2941
query15	214	203	187	187
query16	7413	483	468	468
query17	1262	733	618	618
query18	2019	448	348	348
query19	224	192	167	167
query20	133	122	120	120
query21	217	139	116	116
query22	3908	3998	3850	3850
query23	16628	16198	15933	15933
query23_1	16073	16043	16285	16043
query24	7217	1672	1271	1271
query24_1	1218	1212	1238	1212
query25	661	513	461	461
query26	1272	283	184	184
query27	2876	470	317	317
query28	4404	2197	2181	2181
query29	888	603	508	508
query30	316	246	214	214
query31	800	728	633	633
query32	84	75	74	74
query33	664	340	301	301
query34	862	895	542	542
query35	797	828	747	747
query36	889	914	826	826
query37	124	98	77	77
query38	3871	3911	3835	3835
query39	754	744	719	719
query39_1	696	710	690	690
query40	221	133	119	119
query41	67	64	61	61
query42	124	99	100	99
query43	453	426	392	392
query44	1356	765	752	752
query45	197	194	184	184
query46	923	976	604	604
query47	1701	1735	1632	1632
query48	408	320	239	239
query49	783	423	354	354
query50	703	312	231	231
query51	3928	3854	3802	3802
query52	118	97	86	86
query53	243	237	182	182
query54	316	247	238	238
query55	98	88	78	78
query56	340	293	310	293
query57	1140	1139	1120	1120
query58	298	270	253	253
query59	2329	2437	2318	2318
query60	377	323	304	304
query61	163	159	195	159
query62	789	691	643	643
query63	236	180	182	180
query64	4572	1188	899	899
query65	4098	3995	3986	3986
query66	1254	456	337	337
query67	15422	14868	14910	14868
query68	8280	962	694	694
query69	523	303	268	268
query70	1115	999	1025	999
query71	462	295	283	283
query72	5996	4919	4891	4891
query73	691	560	308	308
query74	8874	8892	8673	8673
query75	3212	3051	2545	2545
query76	3405	1144	771	771
query77	645	418	297	297
query78	9500	9647	8926	8926
query79	1815	854	592	592
query80	705	552	490	490
query81	531	272	244	244
query82	202	133	105	105
query83	277	273	255	255
query84	266	128	95	95
query85	922	490	441	441
query86	377	307	288	288
query87	4096	4060	3904	3904
query88	3413	2176	2155	2155
query89	395	325	292	292
query90	2118	163	158	158
query91	172	169	147	147
query92	87	69	75	69
query93	2141	1032	680	680
query94	768	325	283	283
query95	565	344	331	331
query96	555	507	217	217
query97	2623	2661	2573	2573
query98	255	211	199	199
query99	1355	1345	1259	1259
Total cold run time: 270571 ms
Total hot run time: 180612 ms

doris-robot avatar Dec 04 '25 16:12 doris-robot

ClickBench: Total hot run time: 27.5 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1fc92d856f8a3304e11f18c747bea564a32b60d3, data reload: false

query1	0.05	0.05	0.05
query2	0.11	0.06	0.05
query3	0.26	0.09	0.09
query4	1.61	0.11	0.11
query5	0.28	0.25	0.25
query6	1.16	0.64	0.65
query7	0.03	0.03	0.03
query8	0.06	0.05	0.04
query9	0.60	0.50	0.51
query10	0.56	0.55	0.56
query11	0.16	0.10	0.10
query12	0.15	0.12	0.12
query13	0.62	0.62	0.61
query14	0.99	0.98	1.00
query15	0.83	0.81	0.80
query16	0.42	0.41	0.43
query17	1.03	1.07	1.08
query18	0.23	0.21	0.20
query19	1.95	1.90	1.88
query20	0.02	0.01	0.01
query21	15.45	0.30	0.14
query22	4.70	0.06	0.05
query23	15.84	0.29	0.11
query24	1.18	0.64	0.19
query25	0.10	0.08	0.07
query26	0.14	0.13	0.13
query27	0.05	0.04	0.08
query28	4.47	1.26	1.03
query29	12.61	4.03	3.25
query30	0.28	0.14	0.12
query31	2.83	0.62	0.39
query32	3.24	0.56	0.48
query33	3.04	3.10	3.06
query34	16.91	5.25	4.53
query35	4.59	4.57	4.61
query36	0.67	0.51	0.48
query37	0.11	0.07	0.07
query38	0.07	0.05	0.04
query39	0.05	0.03	0.03
query40	0.16	0.14	0.13
query41	0.10	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.04
Total cold run time: 97.79 s
Total hot run time: 27.5 s

doris-robot avatar Dec 04 '25 16:12 doris-robot

BE UT Coverage Report

Increment line coverage 12.79% (11/86) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 53.32% (18639/34956)
Line Coverage 39.01% (172137/441276)
Region Coverage 33.62% (133304/396467)
Branch Coverage 34.58% (57365/165898)

doris-robot avatar Dec 04 '25 17:12 doris-robot

BE Regression && UT Coverage Report

Increment line coverage 15.12% (13/86) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 72.15% (24730/34276)
Line Coverage 58.88% (259605/440890)
Region Coverage 53.91% (216339/401279)
Branch Coverage 55.36% (92332/166793)

hello-stephen avatar Dec 04 '25 19:12 hello-stephen

FE Regression Coverage Report

Increment line coverage 27.27% (3/11) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 04 '25 19:12 hello-stephen

run buildall

zhangstar333 avatar Dec 05 '25 02:12 zhangstar333

TPC-H: Total hot run time: 34394 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 03d900d320e54160d50198193b6238e2ab16a16f, data reload: false

------ Round 1 ----------------------------------
q1	17643	5043	4866	4866
q2	1997	314	190	190
q3	10303	1345	718	718
q4	10231	949	321	321
q5	7579	2429	2183	2183
q6	185	171	136	136
q7	951	785	637	637
q8	9352	1461	1131	1131
q9	7138	5409	5375	5375
q10	6837	2213	1809	1809
q11	511	316	287	287
q12	351	360	223	223
q13	17782	3671	3027	3027
q14	237	254	211	211
q15	605	518	525	518
q16	912	859	819	819
q17	673	745	556	556
q18	7811	7080	7113	7080
q19	1102	955	607	607
q20	395	343	221	221
q21	4043	3332	2538	2538
q22	1060	1019	941	941
Total cold run time: 107698 ms
Total hot run time: 34394 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4942	4989	4899	4899
q2	336	402	325	325
q3	2158	2637	2332	2332
q4	1334	1742	1305	1305
q5	4231	4544	4530	4530
q6	227	183	134	134
q7	2013	1943	1774	1774
q8	2773	2610	2483	2483
q9	7558	7601	7520	7520
q10	3084	3255	2825	2825
q11	592	519	509	509
q12	683	742	600	600
q13	3505	3966	3270	3270
q14	281	309	279	279
q15	547	506	550	506
q16	874	944	919	919
q17	1171	1369	1410	1369
q18	7938	7842	7605	7605
q19	867	793	839	793
q20	1915	1966	1798	1798
q21	4583	4312	4095	4095
q22	1096	1043	1004	1004
Total cold run time: 52708 ms
Total hot run time: 50874 ms

doris-robot avatar Dec 05 '25 03:12 doris-robot

run buildall

morningman avatar Dec 05 '25 03:12 morningman

run buildall

zhangstar333 avatar Dec 05 '25 03:12 zhangstar333

FE UT Coverage Report

Increment line coverage 0.00% (0/11) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 05 '25 04:12 hello-stephen

TPC-H: Total hot run time: 34293 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f5d350fcd0380a0459e54f533659e2c0011dfb8e, data reload: false

------ Round 1 ----------------------------------
q1	6090	4911	4925	4911
q2	687	308	195	195
q3	905	1293	724	724
q4	9058	815	320	320
q5	7575	2337	2262	2262
q6	198	178	137	137
q7	946	785	644	644
q8	9378	1447	1105	1105
q9	7147	5338	5199	5199
q10	6855	2208	1796	1796
q11	531	327	293	293
q12	353	370	222	222
q13	17815	3675	3005	3005
q14	231	229	211	211
q15	577	530	523	523
q16	908	869	819	819
q17	684	808	488	488
q18	7922	7183	7112	7112
q19	1021	969	591	591
q20	382	359	224	224
q21	3923	3267	2537	2537
q22	1027	1027	975	975
Total cold run time: 84213 ms
Total hot run time: 34293 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4939	4883	4884	4883
q2	329	418	312	312
q3	2155	2643	2281	2281
q4	1341	1780	1281	1281
q5	4217	4152	4122	4122
q6	203	164	125	125
q7	1874	1823	1670	1670
q8	2521	2411	2384	2384
q9	7026	6916	6998	6916
q10	2909	3079	2656	2656
q11	582	504	484	484
q12	628	695	549	549
q13	3245	3633	3024	3024
q14	278	283	266	266
q15	550	505	489	489
q16	860	901	843	843
q17	1118	1375	1350	1350
q18	7315	7081	7122	7081
q19	845	804	812	804
q20	1891	1965	1840	1840
q21	4645	4250	4057	4057
q22	1077	1043	1003	1003
Total cold run time: 50548 ms
Total hot run time: 48420 ms

doris-robot avatar Dec 05 '25 05:12 doris-robot

TPC-DS: Total hot run time: 180033 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f5d350fcd0380a0459e54f533659e2c0011dfb8e, data reload: false

query5	5872	651	491	491
query6	421	235	210	210
query7	4911	476	276	276
query8	342	242	260	242
query9	8723	2639	2631	2631
query10	589	334	284	284
query11	15263	14750	14590	14590
query12	190	118	115	115
query13	1676	482	387	387
query14	7759	3302	3084	3084
query14_1	2919	2976	2973	2973
query15	262	206	198	198
query16	7743	488	488	488
query17	1531	770	613	613
query18	2048	447	354	354
query19	318	191	173	173
query20	133	124	117	117
query21	220	138	117	117
query22	3962	4010	3786	3786
query23	16556	16137	15988	15988
query23_1	15955	15949	16304	15949
query24	6554	1636	1247	1247
query24_1	1248	1201	1223	1201
query25	640	515	441	441
query26	1251	285	174	174
query27	2871	470	312	312
query28	4472	2182	2162	2162
query29	822	594	475	475
query30	323	247	213	213
query31	828	711	662	662
query32	86	71	71	71
query33	661	357	310	310
query34	852	934	541	541
query35	791	823	735	735
query36	898	906	861	861
query37	133	105	81	81
query38	3830	3967	3760	3760
query39	770	732	730	730
query39_1	787	706	686	686
query40	226	135	119	119
query41	65	62	59	59
query42	126	95	95	95
query43	438	420	384	384
query44	1314	759	759	759
query45	200	197	185	185
query46	904	971	586	586
query47	1657	1696	1628	1628
query48	405	325	231	231
query49	754	427	360	360
query50	704	320	234	234
query51	3777	3877	3865	3865
query52	118	100	85	85
query53	225	227	181	181
query54	318	257	243	243
query55	97	79	81	79
query56	337	303	299	299
query57	1157	1139	1083	1083
query58	311	268	259	259
query59	2359	2360	2411	2360
query60	364	318	302	302
query61	160	160	168	160
query62	770	687	613	613
query63	238	184	182	182
query64	4497	1164	904	904
query65	4063	3933	3938	3933
query66	1113	449	345	345
query67	15191	14869	14793	14793
query68	8410	964	662	662
query69	563	311	272	272
query70	1136	1043	969	969
query71	474	293	267	267
query72	5983	5075	4916	4916
query73	692	561	301	301
query74	8804	8717	8614	8614
query75	3519	3042	2571	2571
query76	3549	1143	732	732
query77	781	400	312	312
query78	9418	9600	8841	8841
query79	1714	860	590	590
query80	653	546	459	459
query81	535	271	240	240
query82	335	133	114	114
query83	283	275	258	258
query84	260	113	93	93
query85	886	492	452	452
query86	335	267	297	267
query87	4046	4017	3951	3951
query88	4229	2137	2152	2137
query89	410	342	285	285
query90	2002	172	166	166
query91	174	168	140	140
query92	91	67	64	64
query93	1877	1019	686	686
query94	732	309	282	282
query95	573	384	335	335
query96	543	509	216	216
query97	2643	2657	2612	2612
query98	250	206	195	195
query99	1342	1310	1235	1235
Total cold run time: 274096 ms
Total hot run time: 180033 ms

doris-robot avatar Dec 05 '25 05:12 doris-robot

ClickBench: Total hot run time: 27.36 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f5d350fcd0380a0459e54f533659e2c0011dfb8e, data reload: false

query1	0.05	0.05	0.05
query2	0.10	0.05	0.04
query3	0.25	0.09	0.09
query4	1.61	0.11	0.11
query5	0.29	0.28	0.27
query6	1.18	0.65	0.63
query7	0.04	0.03	0.02
query8	0.06	0.04	0.05
query9	0.57	0.52	0.51
query10	0.57	0.56	0.55
query11	0.16	0.11	0.10
query12	0.15	0.11	0.11
query13	0.62	0.60	0.61
query14	0.98	0.99	0.97
query15	0.81	0.81	0.80
query16	0.40	0.41	0.40
query17	1.00	1.00	1.03
query18	0.26	0.21	0.21
query19	1.89	1.73	1.78
query20	0.02	0.01	0.01
query21	15.45	0.28	0.14
query22	4.98	0.05	0.05
query23	16.07	0.27	0.10
query24	1.47	1.08	0.21
query25	0.08	0.10	0.05
query26	0.14	0.12	0.13
query27	0.08	0.04	0.04
query28	4.85	1.22	1.01
query29	12.56	3.93	3.36
query30	0.31	0.13	0.12
query31	2.82	0.62	0.42
query32	3.23	0.55	0.46
query33	3.00	3.09	3.14
query34	17.01	5.12	4.56
query35	4.60	4.55	4.60
query36	0.65	0.49	0.49
query37	0.11	0.07	0.06
query38	0.07	0.05	0.04
query39	0.04	0.03	0.03
query40	0.16	0.13	0.15
query41	0.08	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.03	0.04
Total cold run time: 98.85 s
Total hot run time: 27.36 s

doris-robot avatar Dec 05 '25 05:12 doris-robot

BE UT Coverage Report

Increment line coverage 12.79% (11/86) :tada:

Increment coverage report Complete coverage report

Category Coverage
Function Coverage 53.27% (18643/34999)
Line Coverage 39.00% (172267/441732)
Region Coverage 33.62% (133323/396578)
Branch Coverage 34.58% (57372/165933)

hello-stephen avatar Dec 05 '25 07:12 hello-stephen

run buildall

zhangstar333 avatar Dec 05 '25 07:12 zhangstar333

TPC-H: Total hot run time: 34401 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 69c327e6af4da00f8cc66aa38b41b6a8a638c28b, data reload: false

------ Round 1 ----------------------------------
q1	17669	5189	4947	4947
q2	2067	316	194	194
q3	10274	1348	777	777
q4	10198	803	315	315
q5	7539	2410	2180	2180
q6	185	176	138	138
q7	948	809	650	650
q8	9370	1451	1155	1155
q9	7076	5310	5378	5310
q10	6849	2194	1769	1769
q11	542	318	300	300
q12	357	363	226	226
q13	17802	3725	3041	3041
q14	229	238	225	225
q15	597	511	509	509
q16	899	864	798	798
q17	699	860	443	443
q18	7538	7164	7057	7057
q19	925	956	604	604
q20	375	354	236	236
q21	4027	3715	2576	2576
q22	1055	976	951	951
Total cold run time: 107220 ms
Total hot run time: 34401 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4984	4968	4972	4968
q2	333	406	315	315
q3	2144	2686	2329	2329
q4	1323	1765	1323	1323
q5	4223	4548	4660	4548
q6	221	178	131	131
q7	2122	1963	1825	1825
q8	2704	2579	2539	2539
q9	7488	7462	7588	7462
q10	3091	3218	2855	2855
q11	624	507	486	486
q12	686	750	639	639
q13	3545	4017	3384	3384
q14	291	319	278	278
q15	530	568	507	507
q16	906	943	884	884
q17	1229	1547	1490	1490
q18	7962	7764	7683	7683
q19	913	882	909	882
q20	1961	2072	1985	1985
q21	4935	4324	4316	4316
q22	1080	1032	974	974
Total cold run time: 53295 ms
Total hot run time: 51803 ms

doris-robot avatar Dec 05 '25 09:12 doris-robot

TPC-DS: Total hot run time: 180087 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 69c327e6af4da00f8cc66aa38b41b6a8a638c28b, data reload: false

query5	5001	650	490	490
query6	359	250	209	209
query7	4663	479	288	288
query8	302	257	261	257
query9	8732	2664	2671	2664
query10	569	340	278	278
query11	15619	15174	14796	14796
query12	202	126	124	124
query13	1723	508	369	369
query14	7710	3238	3083	3083
query14_1	2888	2883	2873	2873
query15	204	203	184	184
query16	7698	487	457	457
query17	1612	740	630	630
query18	2054	451	347	347
query19	226	196	173	173
query20	129	127	121	121
query21	225	141	117	117
query22	4037	4094	4072	4072
query23	16803	16189	15887	15887
query23_1	16209	16001	15998	15998
query24	6823	1644	1205	1205
query24_1	1225	1193	1222	1193
query25	638	504	458	458
query26	1267	287	177	177
query27	2882	474	313	313
query28	4380	2219	2202	2202
query29	836	596	479	479
query30	323	247	222	222
query31	812	702	652	652
query32	93	71	118	71
query33	675	350	299	299
query34	869	901	528	528
query35	812	834	747	747
query36	874	920	830	830
query37	121	104	75	75
query38	3797	3849	3774	3774
query39	762	747	704	704
query39_1	714	708	700	700
query40	235	131	116	116
query41	66	63	63	63
query42	123	96	95	95
query43	427	419	400	400
query44	1301	755	759	755
query45	200	197	186	186
query46	911	957	602	602
query47	1676	1745	1621	1621
query48	405	327	230	230
query49	782	433	356	356
query50	694	297	236	236
query51	3853	3867	3900	3867
query52	118	104	84	84
query53	239	233	178	178
query54	313	280	237	237
query55	98	80	75	75
query56	342	293	308	293
query57	1208	1156	1099	1099
query58	322	257	253	253
query59	2328	2418	2360	2360
query60	379	318	296	296
query61	165	167	202	167
query62	781	703	646	646
query63	227	179	177	177
query64	4523	1193	917	917
query65	4034	3927	3989	3927
query66	1190	454	345	345
query67	15579	15227	14858	14858
query68	8430	934	668	668
query69	528	307	270	270
query70	1125	982	997	982
query71	486	289	276	276
query72	5940	4947	4905	4905
query73	696	554	298	298
query74	8881	8738	8527	8527
query75	3394	2998	2544	2544
query76	3508	1167	740	740
query77	792	408	301	301
query78	9456	9620	8904	8904
query79	1687	844	585	585
query80	659	601	473	473
query81	497	271	244	244
query82	689	131	104	104
query83	287	278	254	254
query84	258	122	98	98
query85	959	503	451	451
query86	345	294	275	275
query87	4063	3951	3967	3951
query88	3835	2123	2115	2115
query89	395	324	282	282
query90	2083	166	156	156
query91	182	169	146	146
query92	87	74	63	63
query93	1246	1045	680	680
query94	822	306	284	284
query95	563	382	325	325
query96	541	509	208	208
query97	2600	2685	2582	2582
query98	240	204	201	201
query99	1357	1314	1265	1265
Total cold run time: 273801 ms
Total hot run time: 180087 ms

doris-robot avatar Dec 05 '25 09:12 doris-robot

ClickBench: Total hot run time: 27.13 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 69c327e6af4da00f8cc66aa38b41b6a8a638c28b, data reload: false

query1	0.05	0.05	0.05
query2	0.09	0.05	0.05
query3	0.25	0.09	0.09
query4	1.61	0.11	0.11
query5	0.29	0.26	0.26
query6	1.19	0.63	0.63
query7	0.03	0.02	0.02
query8	0.06	0.04	0.04
query9	0.58	0.50	0.50
query10	0.55	0.55	0.56
query11	0.16	0.10	0.11
query12	0.14	0.11	0.12
query13	0.62	0.59	0.61
query14	0.99	0.99	0.98
query15	0.82	0.79	0.81
query16	0.41	0.39	0.41
query17	1.10	1.00	1.05
query18	0.23	0.22	0.22
query19	1.87	1.86	1.85
query20	0.02	0.01	0.02
query21	15.45	0.29	0.14
query22	4.82	0.05	0.05
query23	16.07	0.28	0.10
query24	1.59	0.25	0.18
query25	0.09	0.05	0.06
query26	0.16	0.14	0.13
query27	0.06	0.05	0.04
query28	4.06	1.21	1.02
query29	12.62	3.97	3.17
query30	0.28	0.14	0.14
query31	2.82	0.63	0.40
query32	3.23	0.55	0.46
query33	2.99	3.00	3.10
query34	16.81	5.18	4.50
query35	4.57	4.56	4.60
query36	0.65	0.51	0.49
query37	0.11	0.07	0.06
query38	0.08	0.04	0.05
query39	0.05	0.04	0.03
query40	0.18	0.16	0.14
query41	0.10	0.04	0.03
query42	0.04	0.03	0.03
query43	0.04	0.03	0.04
Total cold run time: 97.93 s
Total hot run time: 27.13 s

doris-robot avatar Dec 05 '25 09:12 doris-robot

run buildall

zhangstar333 avatar Dec 05 '25 11:12 zhangstar333

TPC-H: Total hot run time: 34282 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3ea3027aeb52950f741aec353ce3edac3c917d2e, data reload: false

------ Round 1 ----------------------------------
q1	17652	5050	4888	4888
q2	2035	303	192	192
q3	10280	1314	715	715
q4	10208	846	310	310
q5	7512	2492	2176	2176
q6	181	169	136	136
q7	974	810	656	656
q8	9349	1477	1165	1165
q9	7145	5288	5312	5288
q10	6855	2182	1763	1763
q11	500	321	289	289
q12	394	364	225	225
q13	17820	3675	3017	3017
q14	238	234	226	226
q15	590	517	513	513
q16	903	873	818	818
q17	698	859	461	461
q18	8145	7098	7048	7048
q19	1112	974	629	629
q20	385	340	224	224
q21	3961	3309	2581	2581
q22	1100	1025	962	962
Total cold run time: 108037 ms
Total hot run time: 34282 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4943	4927	4892	4892
q2	334	401	323	323
q3	2180	2663	2298	2298
q4	1310	1767	1305	1305
q5	4245	4623	4672	4623
q6	228	178	132	132
q7	2110	1988	1827	1827
q8	2760	2573	2632	2573
q9	7448	7559	7526	7526
q10	3069	3262	2930	2930
q11	604	518	522	518
q12	709	750	627	627
q13	3465	3944	3335	3335
q14	313	351	378	351
q15	615	533	523	523
q16	886	903	893	893
q17	1154	1476	1435	1435
q18	7765	7700	7560	7560
q19	883	858	846	846
q20	2032	2117	1890	1890
q21	4961	4394	4125	4125
q22	1126	1035	992	992
Total cold run time: 53140 ms
Total hot run time: 51524 ms

doris-robot avatar Dec 05 '25 13:12 doris-robot

TPC-DS: Total hot run time: 179623 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3ea3027aeb52950f741aec353ce3edac3c917d2e, data reload: false

query5	5101	646	483	483
query6	339	218	199	199
query7	4675	467	273	273
query8	332	260	247	247
query9	8723	2646	2634	2634
query10	542	309	265	265
query11	15495	14907	14587	14587
query12	185	121	117	117
query13	1683	485	387	387
query14	6230	3273	2963	2963
query14_1	2915	2895	2917	2895
query15	203	195	180	180
query16	7707	493	463	463
query17	1212	718	613	613
query18	2043	433	338	338
query19	216	194	165	165
query20	133	121	119	119
query21	219	135	116	116
query22	3924	4014	3871	3871
query23	16519	16220	15936	15936
query23_1	16076	15935	15990	15935
query24	7280	1604	1216	1216
query24_1	1230	1208	1225	1208
query25	638	502	441	441
query26	1262	303	177	177
query27	2870	492	317	317
query28	4367	2204	2183	2183
query29	824	596	523	523
query30	317	242	208	208
query31	824	715	614	614
query32	84	67	65	65
query33	653	338	283	283
query34	874	868	519	519
query35	805	824	724	724
query36	879	926	824	824
query37	123	92	76	76
query38	3908	3892	3818	3818
query39	751	735	698	698
query39_1	705	695	692	692
query40	223	130	118	118
query41	66	62	63	62
query42	124	105	99	99
query43	430	424	399	399
query44	1298	782	765	765
query45	193	194	189	189
query46	905	966	597	597
query47	1710	1674	1630	1630
query48	409	320	231	231
query49	753	434	348	348
query50	681	308	238	238
query51	3974	3883	3862	3862
query52	113	95	83	83
query53	239	230	173	173
query54	312	254	234	234
query55	95	80	79	79
query56	326	284	294	284
query57	1138	1132	1087	1087
query58	282	255	256	255
query59	2364	2439	2380	2380
query60	370	320	291	291
query61	197	158	156	156
query62	786	651	648	648
query63	229	172	173	172
query64	4553	1205	899	899
query65	4051	3936	3991	3936
query66	1190	438	336	336
query67	15148	14951	14921	14921
query68	8463	944	668	668
query69	513	295	264	264
query70	1101	1003	954	954
query71	470	290	272	272
query72	6063	4944	4953	4944
query73	701	576	301	301
query74	8952	8865	8585	8585
query75	3355	3028	2496	2496
query76	3386	1125	743	743
query77	580	438	318	318
query78	9527	9509	8802	8802
query79	1586	913	575	575
query80	764	548	452	452
query81	515	273	232	232
query82	405	134	103	103
query83	278	270	255	255
query84	264	112	94	94
query85	898	492	451	451
query86	405	310	301	301
query87	3960	4090	3944	3944
query88	3383	2110	2116	2110
query89	391	326	278	278
query90	2068	164	155	155
query91	177	166	139	139
query92	87	67	65	65
query93	2496	993	685	685
query94	776	300	289	289
query95	571	386	330	330
query96	535	501	210	210
query97	2599	2647	2556	2556
query98	252	204	206	204
query99	1362	1319	1237	1237
Total cold run time: 271567 ms
Total hot run time: 179623 ms

doris-robot avatar Dec 05 '25 13:12 doris-robot

ClickBench: Total hot run time: 27.37 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3ea3027aeb52950f741aec353ce3edac3c917d2e, data reload: false

query1	0.06	0.05	0.05
query2	0.10	0.05	0.05
query3	0.26	0.09	0.09
query4	1.60	0.11	0.11
query5	0.30	0.26	0.26
query6	1.17	0.66	0.63
query7	0.04	0.03	0.03
query8	0.06	0.04	0.04
query9	0.58	0.52	0.50
query10	0.55	0.55	0.56
query11	0.16	0.10	0.10
query12	0.15	0.12	0.12
query13	0.62	0.60	0.61
query14	1.02	0.99	1.01
query15	0.81	0.80	0.80
query16	0.39	0.40	0.43
query17	0.99	1.04	1.02
query18	0.23	0.21	0.22
query19	1.89	1.86	1.74
query20	0.01	0.01	0.01
query21	15.44	0.30	0.14
query22	4.58	0.05	0.05
query23	15.82	0.26	0.10
query24	1.63	0.60	0.50
query25	0.10	0.06	0.05
query26	0.14	0.14	0.13
query27	0.05	0.04	0.04
query28	5.00	1.17	1.01
query29	12.60	3.89	3.20
query30	0.28	0.16	0.12
query31	2.82	0.61	0.39
query32	3.23	0.55	0.46
query33	3.00	3.02	3.10
query34	16.75	5.14	4.50
query35	4.60	4.53	4.51
query36	0.68	0.50	0.49
query37	0.10	0.06	0.07
query38	0.07	0.04	0.04
query39	0.05	0.03	0.03
query40	0.17	0.15	0.14
query41	0.08	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 98.26 s
Total hot run time: 27.37 s

doris-robot avatar Dec 05 '25 13:12 doris-robot