doris icon indicating copy to clipboard operation
doris copied to clipboard

[chore](column) add check in assume_mutable

Open Mryange opened this issue 2 weeks ago • 1 comments

What problem does this PR solve?

Release note

None

Check List (For Author)

  • Test

    • [ ] Regression test
    • [ ] Unit Test
    • [ ] Manual test (add detailed scripts or steps below)
    • [ ] No need to test or manual test. Explain why:
      • [ ] This is a refactor/code format and no logic has been changed.
      • [ ] Previous test can cover this change.
      • [ ] No code files have been changed.
      • [ ] Other reason
  • Behavior changed:

    • [ ] No.
    • [ ] Yes.
  • Does this need documentation?

    • [ ] No.
    • [ ] Yes.

Check List (For Reviewer who merge this PR)

  • [ ] Confirm the release note
  • [ ] Confirm test cases
  • [ ] Confirm document
  • [ ] Add branch pick label

Mryange avatar Dec 11 '25 07:12 Mryange

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

Thearas avatar Dec 11 '25 07:12 Thearas

run buildall

Mryange avatar Dec 12 '25 02:12 Mryange

TPC-H: Total hot run time: 35591 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 771628eedfaa4ae2c7cedd2948389e50e008bac6, data reload: false

------ Round 1 ----------------------------------
q1	17595	4184	4068	4068
q2	2030	356	233	233
q3	10181	1367	772	772
q4	10217	900	342	342
q5	7540	2256	1977	1977
q6	200	178	139	139
q7	1013	880	707	707
q8	9372	1463	1237	1237
q9	7446	5369	5391	5369
q10	6908	2399	1992	1992
q11	525	325	288	288
q12	695	767	585	585
q13	17769	3699	3140	3140
q14	293	287	268	268
q15	612	529	522	522
q16	938	919	877	877
q17	742	836	533	533
q18	8349	7147	7052	7052
q19	1137	961	607	607
q20	414	365	253	253
q21	4310	4072	3657	3657
q22	1040	1025	973	973
Total cold run time: 109326 ms
Total hot run time: 35591 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4086	4060	4055	4055
q2	345	413	314	314
q3	2149	2704	2291	2291
q4	1345	1825	1329	1329
q5	4494	4892	4637	4637
q6	221	174	132	132
q7	2094	1980	1824	1824
q8	2771	2655	2583	2583
q9	7911	7783	7356	7356
q10	3109	3276	2842	2842
q11	599	504	501	501
q12	680	766	679	679
q13	3565	4037	3339	3339
q14	316	318	291	291
q15	542	499	504	499
q16	876	932	898	898
q17	1265	1505	1439	1439
q18	8148	7625	7632	7625
q19	871	856	862	856
q20	2073	2058	1917	1917
q21	4968	4550	4204	4204
q22	1070	1030	985	985
Total cold run time: 53498 ms
Total hot run time: 50596 ms

doris-robot avatar Dec 12 '25 04:12 doris-robot

TPC-DS: Total hot run time: 181824 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 771628eedfaa4ae2c7cedd2948389e50e008bac6, data reload: false

query5	4679	639	477	477
query6	325	234	216	216
query7	4229	473	286	286
query8	299	251	243	243
query9	8750	2580	2575	2575
query10	511	383	321	321
query11	15273	14833	14678	14678
query12	184	115	115	115
query13	1262	517	379	379
query14	5842	3278	2998	2998
query14_1	2902	2914	2994	2914
query15	224	198	188	188
query16	917	505	461	461
query17	1152	762	587	587
query18	2475	443	340	340
query19	236	226	200	200
query20	120	120	113	113
query21	221	140	116	116
query22	3906	3975	3880	3880
query23	16681	16303	16001	16001
query23_1	16118	16050	16119	16050
query24	7469	1657	1239	1239
query24_1	1264	1210	1223	1210
query25	558	482	430	430
query26	1261	280	201	201
query27	2731	467	315	315
query28	4476	2151	2144	2144
query29	804	561	443	443
query30	311	250	220	220
query31	844	707	622	622
query32	78	75	78	75
query33	542	347	305	305
query34	905	906	536	536
query35	767	805	723	723
query36	857	891	833	833
query37	150	96	80	80
query38	3945	3896	3802	3802
query39	745	742	715	715
query39_1	704	688	712	688
query40	228	148	124	124
query41	70	66	62	62
query42	110	108	109	108
query43	439	436	409	409
query44	1364	757	752	752
query45	197	195	179	179
query46	882	997	608	608
query47	1685	1699	1612	1612
query48	330	332	256	256
query49	642	445	369	369
query50	673	290	226	226
query51	3906	3917	3791	3791
query52	110	110	104	104
query53	326	353	296	296
query54	294	265	272	265
query55	78	74	73	73
query56	298	299	291	291
query57	1140	1153	1104	1104
query58	271	259	258	258
query59	2383	2502	2363	2363
query60	321	323	301	301
query61	166	195	187	187
query62	715	685	638	638
query63	334	303	311	303
query64	5152	1437	1136	1136
query65	4040	3959	3950	3950
query66	1483	477	343	343
query67	15440	14966	14950	14950
query68	5928	1025	740	740
query69	521	356	324	324
query70	1108	982	981	981
query71	366	317	301	301
query72	6228	5072	5093	5072
query73	699	619	311	311
query74	8837	8757	8652	8652
query75	3601	3514	3176	3176
query76	3868	1156	761	761
query77	525	393	299	299
query78	9596	9657	8873	8873
query79	1760	885	632	632
query80	1557	649	552	552
query81	571	273	242	242
query82	441	130	106	106
query83	362	265	235	235
query84	259	124	103	103
query85	949	526	470	470
query86	389	306	289	289
query87	4106	4070	3882	3882
query88	3255	2312	2290	2290
query89	507	430	398	398
query90	1976	163	163	163
query91	177	170	144	144
query92	74	73	67	67
query93	1179	916	564	564
query94	534	307	285	285
query95	585	340	322	322
query96	584	463	215	215
query97	2564	2640	2605	2605
query98	221	204	185	185
query99	1319	1297	1230	1230
Total cold run time: 262157 ms
Total hot run time: 181824 ms

doris-robot avatar Dec 12 '25 04:12 doris-robot

ClickBench: Total hot run time: 27.28 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 771628eedfaa4ae2c7cedd2948389e50e008bac6, data reload: false

query1	0.05	0.04	0.04
query2	0.10	0.05	0.05
query3	0.25	0.08	0.08
query4	1.62	0.11	0.11
query5	0.27	0.26	0.26
query6	1.16	0.63	0.63
query7	0.03	0.02	0.03
query8	0.05	0.04	0.05
query9	0.58	0.50	0.51
query10	0.55	0.55	0.56
query11	0.16	0.11	0.12
query12	0.16	0.12	0.12
query13	0.63	0.62	0.61
query14	0.99	0.97	0.99
query15	0.81	0.81	0.81
query16	0.39	0.41	0.42
query17	1.03	1.05	0.98
query18	0.24	0.21	0.22
query19	1.87	1.79	1.80
query20	0.02	0.02	0.02
query21	15.44	0.28	0.15
query22	4.79	0.05	0.05
query23	16.01	0.27	0.10
query24	1.32	0.23	0.27
query25	0.06	0.05	0.06
query26	0.14	0.13	0.14
query27	0.05	0.06	0.06
query28	2.86	1.23	1.02
query29	12.58	3.99	3.21
query30	0.28	0.14	0.12
query31	2.82	0.61	0.39
query32	3.23	0.55	0.46
query33	3.00	3.03	3.05
query34	16.93	5.19	4.52
query35	4.57	4.60	4.61
query36	0.66	0.50	0.49
query37	0.11	0.08	0.07
query38	0.07	0.05	0.04
query39	0.05	0.03	0.03
query40	0.17	0.16	0.13
query41	0.08	0.03	0.04
query42	0.05	0.03	0.02
query43	0.04	0.04	0.04
Total cold run time: 96.27 s
Total hot run time: 27.28 s

doris-robot avatar Dec 12 '25 04:12 doris-robot

run buildall

Mryange avatar Dec 12 '25 06:12 Mryange

TPC-H: Total hot run time: 36354 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5c8ccb7c80d01820a759a6f61e8dabb8f307bcfa, data reload: false

------ Round 1 ----------------------------------
q1	17643	4226	4037	4037
q2	2033	363	243	243
q3	10161	1325	751	751
q4	10287	882	308	308
q5	8481	2176	1892	1892
q6	207	171	136	136
q7	1017	870	719	719
q8	9359	1442	1164	1164
q9	7368	5332	5320	5320
q10	6865	2395	1924	1924
q11	548	326	308	308
q12	674	710	568	568
q13	17805	3679	3000	3000
q14	284	298	280	280
q15	595	516	510	510
q16	671	666	626	626
q17	684	804	538	538
q18	7638	7841	7940	7841
q19	1194	1025	663	663
q20	408	355	245	245
q21	4438	4233	4268	4233
q22	1125	1099	1048	1048
Total cold run time: 109485 ms
Total hot run time: 36354 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4323	4250	4234	4234
q2	319	409	315	315
q3	2546	2863	2496	2496
q4	1410	1891	1426	1426
q5	4719	4416	4573	4416
q6	214	168	121	121
q7	2081	1881	1965	1881
q8	2595	2519	2396	2396
q9	7859	7388	7455	7388
q10	2931	3087	2651	2651
q11	563	495	469	469
q12	620	676	575	575
q13	3301	3608	2975	2975
q14	272	278	253	253
q15	530	506	492	492
q16	615	654	594	594
q17	1096	1401	1371	1371
q18	7325	7188	7128	7128
q19	822	800	826	800
q20	1929	1970	1767	1767
q21	4674	4247	4108	4108
q22	1019	1044	952	952
Total cold run time: 51763 ms
Total hot run time: 48808 ms

doris-robot avatar Dec 12 '25 08:12 doris-robot

TPC-DS: Total hot run time: 178331 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5c8ccb7c80d01820a759a6f61e8dabb8f307bcfa, data reload: false

query5	5214	635	477	477
query6	338	227	203	203
query7	4216	458	278	278
query8	297	255	246	246
query9	8767	2535	2559	2535
query10	544	368	330	330
query11	15560	14769	14465	14465
query12	178	123	116	116
query13	1266	485	381	381
query14	6078	3269	2979	2979
query14_1	2889	2861	2835	2835
query15	209	200	178	178
query16	925	466	462	462
query17	1110	690	588	588
query18	2627	426	334	334
query19	219	226	196	196
query20	120	113	108	108
query21	219	142	114	114
query22	4012	4163	3845	3845
query23	16661	16153	16042	16042
query23_1	16019	16019	16239	16019
query24	7372	1660	1243	1243
query24_1	1253	1192	1263	1192
query25	593	552	456	456
query26	1253	278	167	167
query27	2758	476	311	311
query28	4485	2144	2128	2128
query29	815	582	490	490
query30	321	246	218	218
query31	836	711	607	607
query32	81	76	78	76
query33	563	333	302	302
query34	896	915	559	559
query35	806	843	734	734
query36	862	885	835	835
query37	147	94	86	86
query38	2827	2832	2772	2772
query39	778	752	709	709
query39_1	707	713	708	708
query40	233	142	129	129
query41	74	68	68	68
query42	108	105	106	105
query43	433	437	401	401
query44	1329	752	745	745
query45	195	193	186	186
query46	890	993	618	618
query47	1681	1712	1638	1638
query48	316	327	253	253
query49	654	444	368	368
query50	673	303	229	229
query51	3817	3820	3796	3796
query52	107	110	101	101
query53	331	361	301	301
query54	313	276	266	266
query55	84	84	71	71
query56	318	327	318	318
query57	1160	1150	1078	1078
query58	281	262	262	262
query59	2379	2564	2444	2444
query60	341	334	347	334
query61	166	155	155	155
query62	701	679	613	613
query63	327	298	299	298
query64	4943	1289	1015	1015
query65	4059	3982	3958	3958
query66	1411	463	321	321
query67	15233	15159	14938	14938
query68	8281	992	715	715
query69	501	354	308	308
query70	1067	966	1021	966
query71	383	307	291	291
query72	6028	4982	4930	4930
query73	689	585	312	312
query74	8580	8787	8582	8582
query75	3228	3117	2762	2762
query76	3985	1140	735	735
query77	601	402	293	293
query78	9487	9538	8917	8917
query79	1476	863	617	617
query80	702	672	556	556
query81	520	268	236	236
query82	206	138	105	105
query83	271	261	245	245
query84	263	119	99	99
query85	901	515	469	469
query86	378	289	274	274
query87	3030	3063	2924	2924
query88	4386	2289	2288	2288
query89	461	421	394	394
query90	2205	162	161	161
query91	177	168	145	145
query92	87	68	61	61
query93	1670	905	558	558
query94	465	313	273	273
query95	565	384	305	305
query96	584	474	207	207
query97	2241	2288	2233	2233
query98	218	218	188	188
query99	1278	1293	1236	1236
Total cold run time: 262472 ms
Total hot run time: 178331 ms

doris-robot avatar Dec 12 '25 08:12 doris-robot

ClickBench: Total hot run time: 27.39 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5c8ccb7c80d01820a759a6f61e8dabb8f307bcfa, data reload: false

query1	0.05	0.05	0.05
query2	0.11	0.05	0.05
query3	0.25	0.09	0.09
query4	1.61	0.12	0.11
query5	0.29	0.25	0.26
query6	1.17	0.64	0.64
query7	0.03	0.03	0.03
query8	0.06	0.05	0.04
query9	0.58	0.50	0.51
query10	0.57	0.58	0.55
query11	0.15	0.11	0.12
query12	0.16	0.13	0.12
query13	0.62	0.61	0.60
query14	0.99	0.99	0.97
query15	0.81	0.80	0.80
query16	0.40	0.38	0.39
query17	1.04	1.04	1.00
query18	0.24	0.21	0.21
query19	1.86	1.79	1.77
query20	0.02	0.02	0.01
query21	15.44	0.27	0.14
query22	4.72	0.04	0.04
query23	15.96	0.28	0.10
query24	0.99	0.52	0.48
query25	0.08	0.07	0.08
query26	0.14	0.13	0.14
query27	0.07	0.06	0.05
query28	4.21	1.21	1.03
query29	12.58	4.08	3.22
query30	0.29	0.13	0.11
query31	2.82	0.63	0.39
query32	3.23	0.55	0.47
query33	2.90	3.07	3.05
query34	16.89	5.18	4.49
query35	4.46	4.48	4.51
query36	0.67	0.51	0.50
query37	0.11	0.07	0.06
query38	0.08	0.04	0.04
query39	0.04	0.03	0.03
query40	0.16	0.14	0.13
query41	0.08	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.04
Total cold run time: 97.01 s
Total hot run time: 27.39 s

doris-robot avatar Dec 12 '25 08:12 doris-robot

run buildall

Mryange avatar Dec 17 '25 09:12 Mryange

ClickBench: Total hot run time: 29.1 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f179e284085c38a1740c2965cf553731f6c6cefc, data reload: false

query1	0.09	0.09	0.09
query2	0.40	0.30	0.32
query3	0.30	0.09	0.09
query4	1.95	0.11	0.12
query5	0.27	0.27	0.26
query6	1.45	0.71	0.68
query7	0.03	0.02	0.03
query8	0.24	0.04	0.05
query9	0.57	0.52	0.51
query10	0.56	0.54	0.55
query11	0.15	0.10	0.11
query12	0.15	0.12	0.11
query13	0.62	0.60	0.60
query14	1.28	1.00	0.99
query15	0.82	0.81	0.82
query16	0.40	0.41	0.42
query17	1.05	1.06	1.05
query18	0.23	0.21	0.21
query19	1.92	1.85	1.92
query20	0.11	0.01	0.02
query21	15.55	0.32	0.17
query22	4.96	0.06	0.04
query23	16.91	0.55	0.49
query24	1.28	0.45	0.68
query25	0.10	0.06	0.06
query26	0.14	0.13	0.14
query27	0.09	0.06	0.06
query28	4.77	1.20	1.03
query29	15.89	4.41	3.69
query30	0.46	0.14	0.14
query31	2.82	0.63	0.39
query32	3.24	0.55	0.46
query33	3.07	2.98	3.02
query34	16.88	5.15	4.55
query35	4.76	4.64	4.61
query36	0.98	0.67	0.70
query37	0.11	0.07	0.06
query38	0.08	0.04	0.04
query39	0.05	0.03	0.03
query40	0.61	0.17	0.15
query41	0.25	0.04	0.03
query42	0.04	0.04	0.03
query43	2.00	0.06	0.06
Total cold run time: 107.63 s
Total hot run time: 29.1 s

doris-robot avatar Dec 17 '25 13:12 doris-robot

run buildall

Mryange avatar Dec 18 '25 07:12 Mryange

ClickBench: Total hot run time: 27.68 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cf01dc07850810aad8a0f2bca494f7da2e65e393, data reload: false

query1	0.05	0.05	0.05
query2	0.10	0.06	0.05
query3	0.26	0.09	0.09
query4	1.62	0.11	0.11
query5	0.29	0.28	0.27
query6	2.46	0.70	0.68
query7	0.03	0.02	0.03
query8	0.06	0.04	0.04
query9	0.57	0.52	0.51
query10	0.56	0.56	0.55
query11	0.16	0.12	0.11
query12	0.16	0.11	0.12
query13	0.62	0.61	0.60
query14	1.02	1.01	0.99
query15	0.83	0.81	0.82
query16	0.42	0.40	0.42
query17	1.05	1.08	1.02
query18	0.24	0.22	0.22
query19	1.85	1.80	1.95
query20	0.02	0.01	0.01
query21	15.36	0.28	0.14
query22	4.92	0.05	0.04
query23	16.05	0.29	0.11
query24	1.01	0.33	0.53
query25	0.12	0.07	0.05
query26	0.14	0.14	0.13
query27	0.08	0.07	0.05
query28	3.60	1.23	1.05
query29	12.58	4.03	3.36
query30	0.31	0.14	0.13
query31	2.81	0.63	0.39
query32	3.24	0.56	0.46
query33	2.96	3.03	3.01
query34	16.89	5.22	4.57
query35	4.54	4.59	4.59
query36	0.66	0.50	0.48
query37	0.10	0.06	0.06
query38	0.08	0.04	0.04
query39	0.05	0.03	0.03
query40	0.19	0.14	0.13
query41	0.09	0.04	0.03
query42	0.04	0.04	0.03
query43	0.05	0.03	0.04
Total cold run time: 98.24 s
Total hot run time: 27.68 s

doris-robot avatar Dec 18 '25 10:12 doris-robot