doris icon indicating copy to clipboard operation
doris copied to clipboard
verified publisher icon apache

Remove expr nullable

Open morrySnow opened this issue 1 month ago • 67 comments

What problem does this PR solve?

This pull request refactors the handling of nullability in various expression classes within the codebase, standardizing how the nullable property is set and propagated. It removes legacy logic and redundant methods related to nullability checks, and updates constructors to explicitly accept and set the nullable flag. These changes improve clarity and consistency in the expression tree's nullability semantics, especially for integration with Nereids.

Nullability Handling Refactoring

  • Updated constructors for key expression classes (ArithmeticExpr, BinaryPredicate, CaseExpr, CastExpr, CompoundPredicate, ColumnRefExpr) to accept and set a nullable boolean, replacing previous mechanisms and legacy logic. [1] [2] [3] [4] [5] [6]
  • Removed custom isNullable() methods and related logic from multiple classes (BinaryPredicate, CaseExpr, CastExpr, CompoundPredicate, ColumnRefExpr), relying instead on the explicit nullable field. [1] [2] [3] [4] [5]

Literal Expressions Nullability

  • Set nullable = false explicitly in literal expression constructors (BoolLiteral, DateLiteral, ArrayLiteral) to ensure literals are always non-nullable. [1] [2] [3] [4] [5] [6]

Schema Change Logic Update

  • Modified schema change job logic to compute nullability for cast expressions using the new Cast.unStrictCastNullable method, and updated CastExpr instantiation accordingly. [1] [2] [3]

Constructor and Field Cleanup

  • Removed unused fields and legacy constructor patterns (e.g., isNullable in ColumnRefExpr, legacy constructors in BetweenPredicate, and unnecessary use of Preconditions). [1] [2] [3] [4] [5]

Predicate and Expression API Consistency

  • Updated predicate and compound expression APIs to consistently propagate and use the nullable property, including special handling for certain operators. [1] [2]

These changes collectively enhance the reliability and maintainability of expression nullability throughout the codebase.

Release note

None

Check List (For Author)

  • Test

    • [ ] Regression test
    • [ ] Unit Test
    • [ ] Manual test (add detailed scripts or steps below)
    • [x] No need to test or manual test. Explain why:
      • [ ] This is a refactor/code format and no logic has been changed.
      • [x] Previous test can cover this change.
      • [ ] No code files have been changed.
      • [ ] Other reason

  • Behavior changed:

    • [x] No.
    • [ ] Yes.

  • Does this need documentation?

    • [x] No.
    • [ ] Yes.

Check List (For Reviewer who merge this PR)

  • [ ] Confirm the release note
  • [ ] Confirm test cases
  • [ ] Confirm document
  • [ ] Add branch pick label

morrySnow avatar Nov 10 '25 10:11 morrySnow

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

hello-stephen avatar Nov 10 '25 10:11 hello-stephen

run buildall

morrySnow avatar Nov 10 '25 10:11 morrySnow

TPC-H: Total hot run time: 35110 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ba8ec89be40a075b04f07cb75246411d05536d3a, data reload: false

------ Round 1 ----------------------------------
q1	17609	5109	4988	4988
q2	2039	306	203	203
q3	10265	1337	726	726
q4	10236	963	375	375
q5	7506	2386	2416	2386
q6	185	166	135	135
q7	933	782	646	646
q8	9365	1364	1190	1190
q9	7044	5162	5186	5162
q10	6879	2239	1811	1811
q11	518	306	299	299
q12	358	370	246	246
q13	17794	3748	3019	3019
q14	236	238	212	212
q15	573	504	510	504
q16	1006	1014	943	943
q17	585	877	371	371
q18	7391	7576	7635	7576
q19	1635	993	572	572
q20	363	352	234	234
q21	4163	3654	2469	2469
q22	1143	1071	1043	1043
Total cold run time: 107826 ms
Total hot run time: 35110 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5427	5343	5423	5343
q2	262	328	227	227
q3	2416	2957	2550	2550
q4	1468	1917	1429	1429
q5	4558	4481	4520	4481
q6	269	180	128	128
q7	1943	1943	1775	1775
q8	2616	2627	2747	2627
q9	7106	7222	7335	7222
q10	3054	3261	2664	2664
q11	568	505	496	496
q12	634	715	560	560
q13	3286	3716	3045	3045
q14	266	296	273	273
q15	524	489	502	489
q16	1008	1045	1012	1012
q17	1114	1501	1328	1328
q18	7348	7287	7039	7039
q19	751	834	977	834
q20	1875	1993	1795	1795
q21	4755	4301	4367	4301
q22	1084	1013	1019	1013
Total cold run time: 52332 ms
Total hot run time: 50631 ms

doris-robot avatar Nov 10 '25 10:11 doris-robot

TPC-DS: Total hot run time: 188155 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ba8ec89be40a075b04f07cb75246411d05536d3a, data reload: false

query1	1024	404	395	395
query2	6557	1698	1717	1698
query3	6748	238	220	220
query4	26467	23545	23041	23041
query5	4418	617	477	477
query6	333	241	247	241
query7	4646	504	308	308
query8	324	264	266	264
query9	8719	2572	2567	2567
query10	499	329	293	293
query11	15669	15010	14853	14853
query12	178	120	122	120
query13	1696	600	454	454
query14	10914	9355	9196	9196
query15	196	183	182	182
query16	7725	672	480	480
query17	1230	757	612	612
query18	2040	412	316	316
query19	204	210	175	175
query20	133	124	120	120
query21	208	130	111	111
query22	3981	4031	4009	4009
query23	33818	33238	33052	33052
query24	8429	2434	2446	2434
query25	620	521	436	436
query26	1239	273	163	163
query27	2734	495	346	346
query28	4402	2186	2171	2171
query29	805	606	481	481
query30	301	228	193	193
query31	922	822	731	731
query32	83	72	70	70
query33	602	368	328	328
query34	820	854	524	524
query35	826	850	768	768
query36	962	990	888	888
query37	124	116	96	96
query38	3532	3518	3520	3518
query39	1488	1417	1439	1417
query40	225	129	122	122
query41	64	60	94	60
query42	127	112	112	112
query43	506	498	467	467
query44	1281	756	749	749
query45	185	184	177	177
query46	897	1010	654	654
query47	1728	1784	1736	1736
query48	391	430	322	322
query49	759	547	413	413
query50	666	686	411	411
query51	3897	3931	3882	3882
query52	112	114	104	104
query53	242	296	200	200
query54	312	293	272	272
query55	87	90	85	85
query56	323	314	312	312
query57	1180	1175	1125	1125
query58	293	272	282	272
query59	2506	2627	2505	2505
query60	358	348	355	348
query61	167	163	156	156
query62	812	748	673	673
query63	246	199	206	199
query64	4456	1167	902	902
query65	4040	3948	3962	3948
query66	1136	481	362	362
query67	15073	15026	15001	15001
query68	5874	897	598	598
query69	510	331	301	301
query70	1318	1341	1218	1218
query71	422	345	321	321
query72	6256	5181	4994	4994
query73	632	601	372	372
query74	9037	9082	9111	9082
query75	3310	3364	2830	2830
query76	3374	1154	779	779
query77	543	431	325	325
query78	9687	9730	8899	8899
query79	2154	823	594	594
query80	1678	583	509	509
query81	568	258	239	239
query82	420	161	131	131
query83	356	261	248	248
query84	260	121	88	88
query85	948	490	450	450
query86	469	313	306	306
query87	3686	3716	3580	3580
query88	3032	2278	2251	2251
query89	392	326	294	294
query90	1950	227	228	227
query91	171	167	135	135
query92	88	67	63	63
query93	2643	1000	644	644
query94	772	439	344	344
query95	400	326	318	318
query96	499	581	284	284
query97	2891	2981	2905	2905
query98	251	208	206	206
query99	1354	1402	1303	1303
Total cold run time: 273630 ms
Total hot run time: 188155 ms

doris-robot avatar Nov 10 '25 10:11 doris-robot

ClickBench: Total hot run time: 27.69 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ba8ec89be40a075b04f07cb75246411d05536d3a, data reload: false

query1	0.06	0.05	0.05
query2	0.09	0.04	0.05
query3	0.24	0.08	0.08
query4	1.60	0.12	0.11
query5	0.27	0.26	0.25
query6	1.18	0.63	0.64
query7	0.03	0.03	0.02
query8	0.05	0.04	0.04
query9	0.59	0.52	0.53
query10	0.58	0.57	0.56
query11	0.16	0.11	0.12
query12	0.15	0.11	0.12
query13	0.62	0.60	0.60
query14	1.00	1.00	1.01
query15	0.86	0.83	0.84
query16	0.39	0.39	0.40
query17	1.00	1.06	1.04
query18	0.21	0.20	0.19
query19	1.88	1.83	1.79
query20	0.02	0.01	0.01
query21	15.44	0.18	0.13
query22	5.14	0.07	0.05
query23	15.68	0.26	0.11
query24	2.44	0.60	0.67
query25	0.07	0.07	0.07
query26	0.14	0.14	0.13
query27	0.06	0.05	0.06
query28	4.94	1.12	0.94
query29	12.57	3.87	3.26
query30	0.29	0.14	0.14
query31	2.82	0.59	0.38
query32	3.23	0.54	0.48
query33	3.02	3.00	3.00
query34	15.95	5.18	4.54
query35	4.60	4.59	4.57
query36	0.70	0.51	0.50
query37	0.09	0.07	0.07
query38	0.07	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.15	0.14
query41	0.08	0.04	0.03
query42	0.04	0.03	0.03
query43	0.04	0.03	0.04
Total cold run time: 98.6 s
Total hot run time: 27.69 s

doris-robot avatar Nov 10 '25 10:11 doris-robot

FE Regression Coverage Report

Increment line coverage 91.11% (41/45) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Nov 10 '25 14:11 hello-stephen

run buildall

morrySnow avatar Dec 05 '25 10:12 morrySnow

run buildall

morrySnow avatar Dec 05 '25 10:12 morrySnow

TPC-DS: Total hot run time: 11990 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1dc16afb3d0b817aea1dec369c8f3adbbe2a6eb0, data reload: false

query5	
query6	
query7	
query8	
query9	
query10	1511	289	292	289
query11	
query12	
query13	
query14	
query14_1	
query15	
query16	
query17	
query18	
query19	
query20	
query21	
query22	
query23	
query23_1	
query24	
query24_1	
query25	
query26	
query27	
query28	
query29	
query30	
query31	
query32	
query33	
query34	11183	547	528	528
query35	
query36	
query37	590	88	84	84
query38	4294	3738	3741	3738
query39	
query39_1	
query40	
query41	90	80	82	80
query42	
query43	
query44	
query45	
query46	
query47	
query48	
query49	
query50	
query51	
query52	
query53	
query54	
query55	
query56	
query57	
query58	
query59	
query60	
query61	
query62	
query63	
query64	
query65	
query66	
query67	
query68	
query69	627	282	283	282
query70	
query71	
query72	
query73	6937	511	303	303
query74	
query75	
query76	
query77	
query78	
query79	
query80	
query81	
query82	727	149	114	114
query83	
query84	345	141	127	127
query85	
query86	
query87	3988	4049	3963	3963
query88	2823	2104	2125	2104
query89	
query90	2974	175	163	163
query91	
query92	
query93	
query94	
query95	
query96	295	220	215	215
query97	
query98	
query99	
Total cold run time: 36384 ms
Total hot run time: 11990 ms

doris-robot avatar Dec 05 '25 11:12 doris-robot

FE Regression Coverage Report

Increment line coverage 86.21% (25/29) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 05 '25 13:12 hello-stephen

run buildall

morrySnow avatar Dec 05 '25 15:12 morrySnow

TPC-DS: Total hot run time: 11949 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 607cb62a95d3621c9d218f1f9ff13ae267426519, data reload: false

query5	
query6	
query7	
query8	
query9	
query10	1504	292	314	292
query11	
query12	
query13	
query14	
query14_1	
query15	
query16	
query17	
query18	
query19	
query20	
query21	
query22	
query23	
query23_1	
query24	
query24_1	
query25	
query26	
query27	
query28	
query29	
query30	
query31	
query32	
query33	
query34	11173	559	530	530
query35	
query36	
query37	592	88	84	84
query38	4362	3825	3709	3709
query39	
query39_1	
query40	
query41	89	78	80	78
query42	
query43	
query44	
query45	
query46	
query47	
query48	
query49	
query50	
query51	
query52	
query53	
query54	
query55	
query56	
query57	
query58	
query59	
query60	
query61	
query62	
query63	
query64	
query65	
query66	
query67	
query68	
query69	694	295	299	295
query70	
query71	
query72	
query73	7008	529	319	319
query74	
query75	
query76	
query77	
query78	
query79	
query80	
query81	
query82	725	143	120	120
query83	
query84	337	132	111	111
query85	
query86	
query87	3973	4048	3937	3937
query88	2829	2102	2131	2102
query89	
query90	3051	155	155	155
query91	
query92	
query93	
query94	
query95	
query96	297	217	224	217
query97	
query98	
query99	
Total cold run time: 36634 ms
Total hot run time: 11949 ms

doris-robot avatar Dec 05 '25 15:12 doris-robot

FE Regression Coverage Report

Increment line coverage 90.00% (45/50) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 05 '25 18:12 hello-stephen

run buildall

morrySnow avatar Dec 06 '25 01:12 morrySnow

TPC-H: Total hot run time: 33650 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 62e8b32cfd704cbefe9fdeeca631ff19adca6c84, data reload: false

------ Round 1 ----------------------------------
orders	Doris	NULL	NULL	0	0	0	NULL	0	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL	
============================================
q1	17624	5105	4891	4891
q2	q3	9995	1299	791	791
q4	10241	884	316	316
q5	7518	2378	2194	2194
q6	185	168	140	140
q7	955	796	679	679
q8	9942	1463	1138	1138
q9	9140	5264	5317	5264
q10	6838	2199	1772	1772
q11	547	316	292	292
q12	364	371	227	227
q13	17777	3729	3016	3016
q14	231	244	230	230
q15	662	513	509	509
q16	906	876	810	810
q17	q18	7414	7067	7058	7058
q19	1142	989	612	612
q20	371	362	230	230
q21	4080	3984	2530	2530
q22	1056	994	951	951
Total cold run time: 106988 ms
Total hot run time: 33650 ms

----- Round 2, with runtime_filter_mode=off -----
orders	Doris	NULL	NULL	150000000	42	6422171781	NULL	22778155	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL	
============================================
q1	4987	4977	4967	4967
q2	q3	2163	2626	2286	2286
q4	1349	1743	1296	1296
q5	4252	4287	4534	4287
q6	232	177	138	138
q7	2073	2035	1848	1848
q8	2712	2555	2484	2484
q9	7434	7540	7525	7525
q10	3114	3304	2841	2841
q11	592	518	487	487
q12	758	754	692	692
q13	3638	3992	3276	3276
q14	297	309	280	280
q15	574	538	503	503
q16	906	951	907	907
q17	q18	8011	7699	7559	7559
q19	893	904	924	904
q20	1994	2102	1946	1946
q21	4557	4386	4111	4111
q22	1091	1023	979	979
Total cold run time: 51627 ms
Total hot run time: 49316 ms

doris-robot avatar Dec 06 '25 01:12 doris-robot

TPC-DS: Total hot run time: 154402 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 62e8b32cfd704cbefe9fdeeca631ff19adca6c84, data reload: false

query5	5061	643	478	478
query6	348	228	208	208
query7	4669	490	284	284
query8	316	254	246	246
query9	8727	2644	2644	2644
query10	552	324	291	291
query11	15216	14748	14573	14573
query12	
query13	1707	504	368	368
query14	6179	3349	3102	3102
query14_1	2925	2895	2898	2895
query15	217	197	185	185
query16	7655	473	460	460
query17	1242	697	594	594
query18	2026	434	338	338
query19	214	188	158	158
query20	
query21	217	132	124	124
query22	3982	3980	3894	3894
query23	16660	16205	15965	15965
query23_1	16009	16068	16134	16068
query24	7285	1626	1196	1196
query24_1	1210	1219	1228	1219
query25	655	529	475	475
query26	1271	290	178	178
query27	2917	477	314	314
query28	4404	2197	2156	2156
query29	851	583	500	500
query30	320	249	222	222
query31	853	729	621	621
query32	
query33	695	376	321	321
query34	868	883	545	545
query35	799	844	735	735
query36	
query37	128	94	80	80
query38	3866	3799	3850	3799
query39	771	776	734	734
query39_1	728	727	710	710
query40	229	133	127	127
query41	74	68	68	68
query42	158	113	100	100
query43	428	421	403	403
query44	
query45	204	197	185	185
query46	893	984	624	624
query47	
query48	407	320	239	239
query49	
query50	706	328	239	239
query51	
query52	126	96	93	93
query53	
query54	375	296	271	271
query55	104	88	81	81
query56	382	325	295	295
query57	
query58	312	267	262	262
query59	2275	2382	2324	2324
query60	360	322	305	305
query61	161	159	166	159
query62	773	681	625	625
query63	
query64	5183	1168	899	899
query65	4008	3917	3935	3917
query66	1304	487	332	332
query67	
query68	2726	1136	678	678
query69	451	303	262	262
query70	
query71	372	298	269	269
query72	5318	4695	4689	4689
query73	528	560	301	301
query74	8905	8731	8643	8643
query75	2972	3054	2523	2523
query76	2334	1117	731	731
query77	401	411	317	317
query78	9459	9532	8832	8832
query79	2532	857	608	608
query80	1783	549	472	472
query81	551	273	231	231
query82	738	132	103	103
query83	369	288	264	264
query84	255	126	94	94
query85	979	509	464	464
query86	
query87	4107	4132	3967	3967
query88	3136	2134	2118	2118
query89	
query90	1980	166	163	163
query91	173	168	170	168
query92	
query93	1418	1057	697	697
query94	836	321	278	278
query95	604	411	347	347
query96	546	495	215	215
query97	2585	2696	2601	2601
query98	
query99	1352	1360	1239	1239
Total cold run time: 237543 ms
Total hot run time: 154402 ms

doris-robot avatar Dec 06 '25 02:12 doris-robot

ClickBench: Total hot run time: 27.48 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 62e8b32cfd704cbefe9fdeeca631ff19adca6c84, data reload: false

query1	0.05	0.05	0.05
query2	0.10	0.05	0.04
query3	0.26	0.09	0.09
query4	1.61	0.11	0.11
query5	0.27	0.25	0.26
query6	1.18	0.65	0.64
query7	0.03	0.03	0.03
query8	0.06	0.04	0.04
query9	0.55	0.51	0.52
query10	0.56	0.56	0.55
query11	0.16	0.10	0.10
query12	0.14	0.11	0.12
query13	0.62	0.63	0.62
query14	0.98	1.01	0.98
query15	0.80	0.80	0.81
query16	0.39	0.37	0.40
query17	1.06	1.06	1.06
query18	0.23	0.22	0.22
query19	1.87	1.88	1.84
query20	0.02	0.01	0.01
query21	15.42	0.30	0.14
query22	4.91	0.05	0.05
query23	16.01	0.29	0.10
query24	1.60	0.91	0.33
query25	0.09	0.06	0.09
query26	0.14	0.14	0.13
query27	0.07	0.06	0.04
query28	4.15	1.22	1.02
query29	12.59	4.07	3.27
query30	0.27	0.13	0.11
query31	2.81	0.62	0.38
query32	3.23	0.56	0.46
query33	3.12	3.05	3.06
query34	16.95	5.21	4.52
query35	4.56	4.61	4.55
query36	0.65	0.51	0.50
query37	0.12	0.06	0.07
query38	0.08	0.04	0.04
query39	0.04	0.04	0.04
query40	0.17	0.13	0.14
query41	0.08	0.03	0.03
query42	0.04	0.02	0.02
query43	0.05	0.03	0.03
Total cold run time: 98.09 s
Total hot run time: 27.48 s

doris-robot avatar Dec 06 '25 02:12 doris-robot

FE Regression Coverage Report

Increment line coverage 90.20% (46/51) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 06 '25 04:12 hello-stephen

run buildall

morrySnow avatar Dec 06 '25 15:12 morrySnow

TPC-H: Total hot run time: 34040 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a885fdc010a7ec12fb1ffdbf4de5ce6ea7dbf23c, data reload: false

------ Round 1 ----------------------------------
q1	17593	4955	4891	4891
q2	2050	304	188	188
q3	10283	1291	720	720
q4	10206	796	316	316
q5	7513	2405	2134	2134
q6	189	169	138	138
q7	948	780	636	636
q8	9361	1439	1036	1036
q9	6948	5381	5344	5344
q10	6868	2251	1811	1811
q11	522	310	297	297
q12	336	360	237	237
q13	17807	3692	3011	3011
q14	232	243	218	218
q15	593	522	505	505
q16	869	849	814	814
q17	677	730	564	564
q18	7481	7141	6930	6930
q19	1126	952	627	627
q20	369	352	219	219
q21	3883	3142	2442	2442
q22	1037	995	962	962
Total cold run time: 106891 ms
Total hot run time: 34040 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4961	4909	4879	4879
q2	323	419	307	307
q3	2100	2676	2247	2247
q4	1309	1737	1256	1256
q5	4222	4236	4561	4236
q6	219	180	130	130
q7	2056	1975	1865	1865
q8	2695	2555	2555	2555
q9	7583	7516	7478	7478
q10	3030	3323	2807	2807
q11	576	519	524	519
q12	714	753	658	658
q13	3602	3954	3300	3300
q14	304	325	293	293
q15	567	514	499	499
q16	892	941	909	909
q17	1162	1461	1476	1461
q18	7895	7617	7594	7594
q19	833	778	789	778
q20	1861	1967	1811	1811
q21	4557	4344	4092	4092
q22	1104	1012	1003	1003
Total cold run time: 52565 ms
Total hot run time: 50677 ms

doris-robot avatar Dec 06 '25 16:12 doris-robot

TPC-DS: Total hot run time: 180192 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a885fdc010a7ec12fb1ffdbf4de5ce6ea7dbf23c, data reload: false

query5	5058	642	510	510
query6	356	222	213	213
query7	4660	462	275	275
query8	305	269	239	239
query9	8719	2644	2675	2644
query10	554	321	276	276
query11	15407	14752	14944	14752
query12	185	124	115	115
query13	1697	486	377	377
query14	6414	3290	3073	3073
query14_1	2956	2966	2927	2927
query15	210	198	181	181
query16	7690	482	452	452
query17	1215	729	620	620
query18	2054	445	344	344
query19	219	194	173	173
query20	134	122	120	120
query21	225	142	123	123
query22	3970	4077	4106	4077
query23	16645	16113	15873	15873
query23_1	15964	16009	16087	16009
query24	7195	1611	1225	1225
query24_1	1280	1211	1227	1211
query25	656	496	458	458
query26	1256	281	177	177
query27	2881	461	311	311
query28	4359	2181	2173	2173
query29	837	577	481	481
query30	318	250	217	217
query31	808	705	623	623
query32	86	75	83	75
query33	679	368	314	314
query34	862	959	535	535
query35	802	832	734	734
query36	875	918	816	816
query37	127	91	75	75
query38	3891	3796	3788	3788
query39	755	728	712	712
query39_1	772	714	682	682
query40	226	129	118	118
query41	66	61	60	60
query42	125	101	103	101
query43	454	427	405	405
query44	1291	759	755	755
query45	197	194	185	185
query46	911	963	593	593
query47	1679	1750	1618	1618
query48	399	327	238	238
query49	791	433	353	353
query50	689	307	245	245
query51	3838	3923	3829	3829
query52	125	94	88	88
query53	244	234	181	181
query54	315	256	245	245
query55	96	83	82	82
query56	324	299	287	287
query57	1146	1168	1100	1100
query58	289	263	291	263
query59	2257	2411	2321	2321
query60	381	313	302	302
query61	165	161	160	160
query62	780	717	634	634
query63	240	179	189	179
query64	4486	1151	871	871
query65	4052	3983	3957	3957
query66	1159	441	347	347
query67	15112	14902	15070	14902
query68	8383	932	665	665
query69	515	287	261	261
query70	1096	1039	998	998
query71	490	305	275	275
query72	5675	4791	4993	4791
query73	695	529	298	298
query74	8880	8767	8444	8444
query75	3659	3007	2511	2511
query76	3708	1131	780	780
query77	834	398	290	290
query78	9430	9693	8959	8959
query79	1926	879	589	589
query80	695	553	467	467
query81	516	274	242	242
query82	216	128	107	107
query83	283	274	262	262
query84	274	121	98	98
query85	887	498	478	478
query86	392	300	281	281
query87	4083	3993	3965	3965
query88	4293	2122	2148	2122
query89	390	321	283	283
query90	2072	166	164	164
query91	176	164	141	141
query92	87	68	63	63
query93	1997	1063	670	670
query94	726	318	268	268
query95	556	385	357	357
query96	539	500	214	214
query97	2600	2693	2614	2614
query98	247	201	198	198
query99	1344	1318	1220	1220
Total cold run time: 272780 ms
Total hot run time: 180192 ms

doris-robot avatar Dec 06 '25 16:12 doris-robot

ClickBench: Total hot run time: 27.27 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a885fdc010a7ec12fb1ffdbf4de5ce6ea7dbf23c, data reload: false

query1	0.05	0.05	0.05
query2	0.09	0.05	0.05
query3	0.26	0.09	0.09
query4	1.61	0.11	0.11
query5	0.26	0.27	0.27
query6	1.17	0.64	0.63
query7	0.03	0.03	0.02
query8	0.05	0.04	0.04
query9	0.57	0.52	0.51
query10	0.56	0.56	0.56
query11	0.16	0.11	0.12
query12	0.15	0.11	0.11
query13	0.61	0.60	0.61
query14	0.99	0.99	0.99
query15	0.80	0.80	0.80
query16	0.40	0.39	0.41
query17	1.09	1.00	1.03
query18	0.23	0.22	0.20
query19	1.91	1.87	1.80
query20	0.02	0.01	0.01
query21	15.44	0.32	0.13
query22	4.65	0.06	0.05
query23	16.05	0.29	0.10
query24	1.30	0.24	0.30
query25	0.08	0.06	0.05
query26	0.14	0.13	0.14
query27	0.07	0.04	0.06
query28	3.28	1.23	1.02
query29	12.60	4.04	3.19
query30	0.28	0.14	0.12
query31	2.82	0.64	0.39
query32	3.23	0.56	0.46
query33	2.98	3.07	3.08
query34	16.82	5.15	4.54
query35	4.54	4.56	4.57
query36	0.65	0.51	0.48
query37	0.11	0.08	0.06
query38	0.06	0.05	0.04
query39	0.05	0.03	0.03
query40	0.17	0.14	0.14
query41	0.09	0.04	0.03
query42	0.05	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 96.51 s
Total hot run time: 27.27 s

doris-robot avatar Dec 06 '25 16:12 doris-robot

FE Regression Coverage Report

Increment line coverage 87.50% (63/72) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 06 '25 21:12 hello-stephen

run buildall

morrySnow avatar Dec 07 '25 07:12 morrySnow

TPC-H: Total hot run time: 34156 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dda370b7961c1d2b6e31f1fb5cd380cb45426988, data reload: false

------ Round 1 ----------------------------------
q1	17607	5095	4909	4909
q2	2083	322	206	206
q3	10313	1306	737	737
q4	10231	892	324	324
q5	7544	2466	2128	2128
q6	191	174	140	140
q7	959	796	628	628
q8	9350	1436	1061	1061
q9	7001	5378	5323	5323
q10	6852	2189	1788	1788
q11	511	319	297	297
q12	341	372	230	230
q13	17806	3685	3021	3021
q14	229	233	213	213
q15	597	515	512	512
q16	888	874	817	817
q17	690	830	442	442
q18	7367	7075	7062	7062
q19	1351	963	608	608
q20	367	356	223	223
q21	3992	3332	2528	2528
q22	1021	988	959	959
Total cold run time: 107291 ms
Total hot run time: 34156 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5005	4936	4927	4927
q2	337	386	326	326
q3	2178	2676	2241	2241
q4	1297	1724	1269	1269
q5	4198	4454	4636	4454
q6	223	176	131	131
q7	2047	1963	1844	1844
q8	2752	2539	2549	2539
q9	7579	7602	7512	7512
q10	3103	3300	2856	2856
q11	594	515	503	503
q12	720	784	638	638
q13	3531	3890	3269	3269
q14	289	321	291	291
q15	550	522	507	507
q16	888	970	890	890
q17	1241	1484	1419	1419
q18	7970	7619	7667	7619
q19	894	829	847	829
q20	1917	1967	1828	1828
q21	4616	4238	4138	4138
q22	1097	1043	975	975
Total cold run time: 53026 ms
Total hot run time: 51005 ms

doris-robot avatar Dec 07 '25 08:12 doris-robot

TPC-DS: Total hot run time: 180153 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dda370b7961c1d2b6e31f1fb5cd380cb45426988, data reload: false

query5	4395	643	542	542
query6	357	236	228	228
query7	4641	468	282	282
query8	317	237	239	237
query9	8714	2645	2651	2645
query10	532	323	275	275
query11	15353	15143	14543	14543
query12	193	121	115	115
query13	1701	489	386	386
query14	6447	3262	3025	3025
query14_1	2976	2951	2887	2887
query15	225	203	186	186
query16	7695	493	455	455
query17	1263	725	607	607
query18	2046	439	352	352
query19	216	195	164	164
query20	127	120	120	120
query21	226	143	118	118
query22	4096	4110	4157	4110
query23	16605	16252	15995	15995
query23_1	16122	16140	16085	16085
query24	7279	1656	1198	1198
query24_1	1227	1211	1242	1211
query25	635	505	460	460
query26	1268	301	176	176
query27	2876	473	354	354
query28	4321	2166	2155	2155
query29	779	559	438	438
query30	307	237	212	212
query31	834	709	602	602
query32	86	67	69	67
query33	656	346	290	290
query34	871	881	547	547
query35	823	832	737	737
query36	890	933	803	803
query37	122	91	82	82
query38	3856	3885	3771	3771
query39	755	756	728	728
query39_1	716	703	700	700
query40	226	130	120	120
query41	72	64	64	64
query42	131	100	100	100
query43	453	419	396	396
query44	1315	756	771	756
query45	198	189	183	183
query46	907	971	608	608
query47	1701	1760	1656	1656
query48	409	322	233	233
query49	796	438	364	364
query50	682	317	237	237
query51	3816	3891	3802	3802
query52	120	95	86	86
query53	231	235	175	175
query54	355	254	231	231
query55	96	79	75	75
query56	344	287	310	287
query57	1155	1171	1110	1110
query58	305	259	263	259
query59	2316	2377	2302	2302
query60	375	326	302	302
query61	162	170	159	159
query62	780	689	644	644
query63	231	173	186	173
query64	4437	1202	898	898
query65	4045	3930	3989	3930
query66	1172	452	340	340
query67	15155	15081	15044	15044
query68	6675	959	671	671
query69	511	300	265	265
query70	1154	1016	1025	1016
query71	433	302	277	277
query72	5927	4843	4985	4843
query73	682	533	293	293
query74	8545	8910	8684	8684
query75	3053	3015	2535	2535
query76	3371	1160	759	759
query77	530	417	313	313
query78	9452	9845	8921	8921
query79	1110	900	580	580
query80	700	553	494	494
query81	490	272	237	237
query82	292	129	105	105
query83	278	269	260	260
query84	259	121	96	96
query85	910	506	448	448
query86	317	293	283	283
query87	3987	4042	3957	3957
query88	2940	2105	2114	2105
query89	398	321	286	286
query90	1869	162	156	156
query91	170	170	153	153
query92	75	68	68	68
query93	1222	1031	686	686
query94	701	321	269	269
query95	575	342	331	331
query96	555	489	212	212
query97	2581	2665	2586	2586
query98	247	203	196	196
query99	1350	1344	1236	1236
Total cold run time: 265583 ms
Total hot run time: 180153 ms

doris-robot avatar Dec 07 '25 08:12 doris-robot

ClickBench: Total hot run time: 27.3 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dda370b7961c1d2b6e31f1fb5cd380cb45426988, data reload: false

query1	0.05	0.04	0.05
query2	0.09	0.05	0.05
query3	0.25	0.09	0.09
query4	1.61	0.11	0.11
query5	0.28	0.28	0.28
query6	1.16	0.65	0.63
query7	0.04	0.02	0.03
query8	0.06	0.05	0.05
query9	0.57	0.50	0.50
query10	0.57	0.57	0.56
query11	0.15	0.11	0.11
query12	0.16	0.11	0.12
query13	0.63	0.60	0.60
query14	1.00	0.99	1.00
query15	0.83	0.80	0.81
query16	0.39	0.39	0.39
query17	1.09	1.02	1.04
query18	0.24	0.22	0.21
query19	1.98	1.83	1.90
query20	0.02	0.02	0.01
query21	15.45	0.29	0.14
query22	4.64	0.05	0.05
query23	15.99	0.30	0.10
query24	1.66	0.68	0.20
query25	0.07	0.05	0.10
query26	0.15	0.13	0.14
query27	0.10	0.06	0.04
query28	4.77	1.24	1.02
query29	12.62	3.92	3.23
query30	0.28	0.14	0.12
query31	2.81	0.63	0.40
query32	3.22	0.56	0.46
query33	3.04	3.04	3.05
query34	16.95	5.25	4.51
query35	4.65	4.57	4.64
query36	0.68	0.51	0.49
query37	0.11	0.07	0.06
query38	0.08	0.04	0.04
query39	0.04	0.03	0.03
query40	0.18	0.14	0.14
query41	0.09	0.03	0.02
query42	0.05	0.03	0.03
query43	0.05	0.04	0.03
Total cold run time: 98.85 s
Total hot run time: 27.3 s

doris-robot avatar Dec 07 '25 08:12 doris-robot

run buildall

morrySnow avatar Dec 07 '25 09:12 morrySnow

TPC-H: Total hot run time: 34276 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8a15b98c8352dbacb317bb27e7a3d00855f84e66, data reload: false

------ Round 1 ----------------------------------
q1	17663	5092	4897	4897
q2	2019	298	191	191
q3	10278	1319	754	754
q4	10227	840	308	308
q5	7554	2389	2155	2155
q6	189	169	136	136
q7	968	780	626	626
q8	9362	1441	1092	1092
q9	6948	5400	5410	5400
q10	6833	2217	1772	1772
q11	532	304	286	286
q12	340	364	237	237
q13	17769	3607	3007	3007
q14	236	231	213	213
q15	599	510	525	510
q16	913	878	830	830
q17	706	790	520	520
q18	8056	7097	7076	7076
q19	1102	965	597	597
q20	375	341	222	222
q21	3936	3147	2481	2481
q22	1041	982	966	966
Total cold run time: 107646 ms
Total hot run time: 34276 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4889	4945	4877	4877
q2	322	405	309	309
q3	2135	2674	2297	2297
q4	1317	1728	1310	1310
q5	4205	4418	4426	4418
q6	227	186	135	135
q7	2125	1970	1885	1885
q8	2714	2517	2522	2517
q9	7456	7509	7441	7441
q10	3111	3296	2865	2865
q11	586	507	498	498
q12	651	743	628	628
q13	3624	4045	3258	3258
q14	310	307	283	283
q15	566	513	506	506
q16	904	940	873	873
q17	1253	1444	1380	1380
q18	7780	7697	7562	7562
q19	907	882	929	882
q20	1993	2075	1922	1922
q21	4802	4248	4065	4065
q22	1097	1058	996	996
Total cold run time: 52974 ms
Total hot run time: 50907 ms

doris-robot avatar Dec 07 '25 10:12 doris-robot

TPC-DS: Total hot run time: 179066 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8a15b98c8352dbacb317bb27e7a3d00855f84e66, data reload: false

query5	5037	664	506	506
query6	348	244	210	210
query7	4670	473	271	271
query8	312	255	239	239
query9	8738	2653	2608	2608
query10	552	325	267	267
query11	15375	15152	15074	15074
query12	182	116	121	116
query13	1692	514	404	404
query14	6202	3253	3065	3065
query14_1	2935	2884	2918	2884
query15	206	191	184	184
query16	7493	459	442	442
query17	1180	697	580	580
query18	2008	421	332	332
query19	210	191	161	161
query20	131	120	118	118
query21	226	135	109	109
query22	4298	4215	4201	4201
query23	16546	16195	16059	16059
query23_1	16045	16059	16062	16059
query24	7330	1658	1207	1207
query24_1	1203	1191	1215	1191
query25	620	471	408	408
query26	1258	282	203	203
query27	2882	467	302	302
query28	4400	2171	2163	2163
query29	827	558	451	451
query30	311	243	214	214
query31	808	702	625	625
query32	83	84	74	74
query33	665	354	290	290
query34	859	873	557	557
query35	775	819	764	764
query36	911	918	835	835
query37	127	92	77	77
query38	3893	3915	3762	3762
query39	759	726	758	726
query39_1	705	698	703	698
query40	228	131	117	117
query41	65	65	77	65
query42	130	96	96	96
query43	431	427	395	395
query44	1323	761	753	753
query45	195	195	185	185
query46	907	1003	598	598
query47	1704	1740	1666	1666
query48	416	333	239	239
query49	812	431	354	354
query50	692	296	243	243
query51	3897	3928	3859	3859
query52	115	101	87	87
query53	236	239	179	179
query54	311	249	236	236
query55	98	75	73	73
query56	356	297	292	292
query57	1167	1165	1102	1102
query58	296	256	259	256
query59	2359	2457	2589	2457
query60	359	333	312	312
query61	160	160	160	160
query62	789	679	640	640
query63	238	178	179	178
query64	4608	1187	1033	1033
query65	4049	3989	3993	3989
query66	1265	472	372	372
query67	15232	15012	14771	14771
query68	3104	1011	687	687
query69	514	309	279	279
query70	1155	1005	1020	1005
query71	399	302	279	279
query72	6376	5154	2791	2791
query73	566	576	307	307
query74	8886	8765	8671	8671
query75	3037	3032	2472	2472
query76	2970	1236	742	742
query77	509	403	302	302
query78	9651	9699	8996	8996
query79	2024	852	591	591
query80	1681	569	455	455
query81	552	271	232	232
query82	400	132	105	105
query83	376	272	255	255
query84	257	120	98	98
query85	928	496	458	458
query86	383	315	305	305
query87	4099	4021	3922	3922
query88	3008	2161	2141	2141
query89	394	312	291	291
query90	1868	164	159	159
query91	170	167	142	142
query92	73	70	66	66
query93	1273	1061	689	689
query94	769	304	295	295
query95	579	343	324	324
query96	547	482	221	221
query97	2607	2657	2591	2591
query98	252	201	195	195
query99	1345	1317	1237	1237
Total cold run time: 266016 ms
Total hot run time: 179066 ms

doris-robot avatar Dec 07 '25 10:12 doris-robot