doris icon indicating copy to clipboard operation
doris copied to clipboard

[test](mtmv) Add ut test for session variable guard when generate mtmv cache

Open seawinde opened this issue 1 month ago • 17 comments

What problem does this PR solve?

mtmvCache is globally reused, and each query shares the same instance of mtmvCache. When generating the cache, it should not include any attributes that are specific to an individual query.

current code has no problem, just add some ut

Issue Number: close #xxx

Related PR: https://github.com/apache/doris/pull/58031

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • [ ] Regression test
    • [x] Unit Test
    • [ ] Manual test (add detailed scripts or steps below)
    • [ ] No need to test or manual test. Explain why:
      • [ ] This is a refactor/code format and no logic has been changed.
      • [ ] Previous test can cover this change.
      • [ ] No code files have been changed.
      • [ ] Other reason
  • Behavior changed:

    • [ ] No.
    • [ ] Yes.
  • Does this need documentation?

    • [ ] No.
    • [ ] Yes.

Check List (For Reviewer who merge this PR)

  • [ ] Confirm the release note
  • [ ] Confirm test cases
  • [ ] Confirm document
  • [ ] Add branch pick label

seawinde avatar Dec 09 '25 12:12 seawinde

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

hello-stephen avatar Dec 09 '25 12:12 hello-stephen

run buildall

seawinde avatar Dec 09 '25 12:12 seawinde

TPC-DS: Total hot run time: 183170 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cfd72a30f9da6ee080d0573fea86b204b8dcc6b2, data reload: false

query5	4994	638	469	469
query6	328	230	233	230
query7	4251	468	277	277
query8	300	254	246	246
query9	8785	2613	2651	2613
query10	525	358	325	325
query11	15177	15161	15763	15161
query12	204	125	126	125
query13	1279	565	429	429
query14	6577	3440	3181	3181
query14_1	3059	3040	3068	3040
query15	221	209	184	184
query16	969	550	519	519
query17	1827	727	620	620
query18	2765	461	344	344
query19	255	236	216	216
query20	125	125	113	113
query21	217	135	124	124
query22	4486	4678	4411	4411
query23	17409	16717	16217	16217
query23_1	16486	16204	16176	16176
query24	7318	1640	1218	1218
query24_1	1235	1216	1222	1216
query25	543	458	398	398
query26	1245	256	160	160
query27	2778	460	309	309
query28	4393	2165	2147	2147
query29	790	528	424	424
query30	305	241	204	204
query31	819	702	622	622
query32	74	65	61	61
query33	531	335	281	281
query34	893	894	544	544
query35	788	802	736	736
query36	853	916	826	826
query37	130	90	79	79
query38	3920	3810	3783	3783
query39	746	726	692	692
query39_1	709	719	686	686
query40	227	138	119	119
query41	60	57	56	56
query42	102	100	96	96
query43	413	425	417	417
query44	1329	771	749	749
query45	198	185	184	184
query46	884	979	603	603
query47	1625	1701	1609	1609
query48	338	330	242	242
query49	609	431	352	352
query50	681	286	227	227
query51	3903	3903	3863	3863
query52	113	113	100	100
query53	326	356	300	300
query54	313	282	275	275
query55	81	76	73	73
query56	317	310	315	310
query57	1157	1130	1114	1114
query58	279	268	265	265
query59	2428	2532	2445	2445
query60	329	331	305	305
query61	193	182	188	182
query62	731	675	625	625
query63	332	299	299	299
query64	5016	1371	996	996
query65	4066	3982	3965	3965
query66	1407	437	325	325
query67	15291	15070	14834	14834
query68	8465	1016	741	741
query69	492	364	307	307
query70	1038	1026	950	950
query71	396	309	304	304
query72	6024	5022	5083	5022
query73	713	633	305	305
query74	8991	8900	8624	8624
query75	3985	3516	3191	3191
query76	4363	1148	745	745
query77	850	408	304	304
query78	9539	9696	8759	8759
query79	1597	892	624	624
query80	687	644	553	553
query81	516	276	239	239
query82	502	134	106	106
query83	268	255	245	245
query84	268	122	93	93
query85	981	506	463	463
query86	399	313	281	281
query87	4112	4050	4067	4050
query88	4297	2253	2290	2253
query89	465	418	385	385
query90	2156	163	146	146
query91	169	164	149	149
query92	85	63	68	63
query93	1670	927	572	572
query94	452	304	259	259
query95	576	334	359	334
query96	584	471	210	210
query97	2589	2662	2552	2552
query98	212	199	189	189
query99	1282	1289	1191	1191
Total cold run time: 269818 ms
Total hot run time: 183170 ms

doris-robot avatar Dec 09 '25 13:12 doris-robot

ClickBench: Total hot run time: 27.24 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cfd72a30f9da6ee080d0573fea86b204b8dcc6b2, data reload: false

query1	0.05	0.05	0.05
query2	0.10	0.04	0.04
query3	0.26	0.09	0.08
query4	1.60	0.11	0.11
query5	0.28	0.26	0.28
query6	1.16	0.63	0.62
query7	0.04	0.03	0.03
query8	0.05	0.04	0.04
query9	0.58	0.51	0.50
query10	0.56	0.55	0.54
query11	0.15	0.10	0.10
query12	0.14	0.11	0.12
query13	0.62	0.60	0.61
query14	0.99	0.99	0.99
query15	0.82	0.81	0.80
query16	0.43	0.40	0.38
query17	1.00	1.07	1.04
query18	0.23	0.21	0.22
query19	2.01	1.75	1.79
query20	0.02	0.01	0.01
query21	15.46	0.29	0.14
query22	4.93	0.06	0.04
query23	16.16	0.29	0.10
query24	1.00	0.66	0.30
query25	0.08	0.08	0.06
query26	0.15	0.14	0.13
query27	0.06	0.07	0.06
query28	3.07	1.25	1.02
query29	12.58	4.00	3.14
query30	0.28	0.14	0.12
query31	2.81	0.64	0.39
query32	3.23	0.56	0.47
query33	3.11	3.13	3.11
query34	16.79	5.15	4.54
query35	4.58	4.51	4.57
query36	0.67	0.50	0.48
query37	0.11	0.06	0.07
query38	0.07	0.04	0.04
query39	0.04	0.04	0.03
query40	0.17	0.15	0.14
query41	0.09	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.04
Total cold run time: 96.61 s
Total hot run time: 27.24 s

doris-robot avatar Dec 09 '25 13:12 doris-robot

FE UT Coverage Report

Increment line coverage 85.71% (6/7) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 09 '25 13:12 hello-stephen

run buildall

seawinde avatar Dec 09 '25 13:12 seawinde

TPC-H: Total hot run time: 36279 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cfd72a30f9da6ee080d0573fea86b204b8dcc6b2, data reload: false

------ Round 1 ----------------------------------
q1	17689	5103	4928	4928
q2	2026	350	239	239
q3	10176	1301	760	760
q4	10205	847	322	322
q5	7528	2151	1948	1948
q6	190	167	139	139
q7	1002	861	729	729
q8	9367	1421	1167	1167
q9	6980	5379	5279	5279
q10	6843	2389	1975	1975
q11	510	324	298	298
q12	677	722	570	570
q13	17794	3669	3083	3083
q14	298	290	281	281
q15	593	519	519	519
q16	932	903	861	861
q17	742	783	552	552
q18	7595	7157	7012	7012
q19	1148	950	610	610
q20	393	366	250	250
q21	4183	3920	3800	3800
q22	1009	986	957	957
Total cold run time: 107880 ms
Total hot run time: 36279 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4987	4932	4901	4901
q2	329	387	309	309
q3	2105	2690	2289	2289
q4	1322	1771	1301	1301
q5	4726	4756	4448	4448
q6	225	173	135	135
q7	2063	1996	1767	1767
q8	2696	2568	2516	2516
q9	7543	7431	7468	7431
q10	3018	3327	2973	2973
q11	623	518	494	494
q12	672	756	617	617
q13	3627	3967	3437	3437
q14	293	304	279	279
q15	545	495	504	495
q16	898	933	906	906
q17	1196	1439	1398	1398
q18	7973	7495	7599	7495
q19	906	880	906	880
q20	2029	2068	1907	1907
q21	4660	4334	4161	4161
q22	1090	1047	970	970
Total cold run time: 53526 ms
Total hot run time: 51109 ms

doris-robot avatar Dec 09 '25 14:12 doris-robot

TPC-DS: Total hot run time: 181826 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cfd72a30f9da6ee080d0573fea86b204b8dcc6b2, data reload: false

query5	4941	659	504	504
query6	337	234	231	231
query7	4226	498	277	277
query8	300	260	255	255
query9	8790	2614	2645	2614
query10	538	370	339	339
query11	15410	14791	14943	14791
query12	192	117	115	115
query13	1253	511	381	381
query14	6012	3357	3085	3085
query14_1	3003	2984	3001	2984
query15	213	199	183	183
query16	873	476	489	476
query17	1163	731	615	615
query18	2499	460	358	358
query19	242	237	220	220
query20	129	116	111	111
query21	223	136	118	118
query22	3918	3972	3861	3861
query23	16405	16133	15811	15811
query23_1	16036	15882	16142	15882
query24	7439	1677	1262	1262
query24_1	1254	1260	1279	1260
query25	586	510	491	491
query26	1250	270	165	165
query27	2778	485	311	311
query28	4459	2138	2131	2131
query29	787	546	444	444
query30	314	245	220	220
query31	821	723	617	617
query32	77	69	73	69
query33	542	336	288	288
query34	909	948	549	549
query35	780	808	736	736
query36	894	914	824	824
query37	141	92	80	80
query38	3804	3816	3761	3761
query39	768	740	715	715
query39_1	704	705	708	705
query40	229	136	123	123
query41	67	68	64	64
query42	108	109	109	109
query43	435	440	411	411
query44	1390	761	769	761
query45	200	190	185	185
query46	910	988	640	640
query47	1658	1695	1630	1630
query48	318	327	252	252
query49	645	475	355	355
query50	679	304	221	221
query51	3861	3906	3942	3906
query52	111	113	104	104
query53	332	358	309	309
query54	305	265	251	251
query55	84	78	72	72
query56	325	329	315	315
query57	1114	1140	1077	1077
query58	282	258	256	256
query59	2222	2331	2368	2331
query60	329	310	302	302
query61	165	161	158	158
query62	710	674	631	631
query63	328	302	306	302
query64	5017	1299	1004	1004
query65	4000	3944	3934	3934
query66	1478	440	329	329
query67	15377	14877	14657	14657
query68	4592	1047	747	747
query69	496	365	321	321
query70	1096	1017	996	996
query71	377	319	295	295
query72	6070	5165	5334	5165
query73	670	639	319	319
query74	8643	8808	8572	8572
query75	3567	3524	3174	3174
query76	3869	1154	767	767
query77	532	406	293	293
query78	9462	9649	8862	8862
query79	1686	924	628	628
query80	722	679	559	559
query81	519	277	238	238
query82	213	132	104	104
query83	266	267	244	244
query84	259	117	100	100
query85	903	501	473	473
query86	383	311	285	285
query87	4076	4002	3961	3961
query88	3292	2302	2263	2263
query89	458	432	403	403
query90	2096	166	161	161
query91	169	177	157	157
query92	79	73	64	64
query93	1329	918	587	587
query94	483	318	279	279
query95	581	390	319	319
query96	612	478	219	219
query97	2590	2596	2580	2580
query98	222	200	191	191
query99	1290	1305	1212	1212
Total cold run time: 259085 ms
Total hot run time: 181826 ms

doris-robot avatar Dec 09 '25 14:12 doris-robot

ClickBench: Total hot run time: 27.27 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cfd72a30f9da6ee080d0573fea86b204b8dcc6b2, data reload: false

query1	0.05	0.05	0.05
query2	0.09	0.05	0.05
query3	0.25	0.08	0.09
query4	1.61	0.11	0.11
query5	0.27	0.25	0.27
query6	1.18	0.64	0.64
query7	0.04	0.03	0.03
query8	0.05	0.04	0.04
query9	0.57	0.51	0.50
query10	0.55	0.56	0.54
query11	0.16	0.11	0.11
query12	0.15	0.12	0.11
query13	0.61	0.60	0.60
query14	0.99	0.99	0.98
query15	0.82	0.80	0.82
query16	0.39	0.41	0.42
query17	1.06	1.02	1.02
query18	0.23	0.22	0.22
query19	1.89	1.80	1.76
query20	0.02	0.01	0.01
query21	15.47	0.30	0.14
query22	4.90	0.05	0.05
query23	15.98	0.28	0.10
query24	1.26	0.66	0.22
query25	0.09	0.07	0.07
query26	0.13	0.14	0.14
query27	0.07	0.04	0.06
query28	4.04	1.22	1.03
query29	12.61	4.13	3.18
query30	0.29	0.14	0.14
query31	2.82	0.62	0.41
query32	3.23	0.56	0.47
query33	3.10	3.17	3.08
query34	16.86	5.23	4.52
query35	4.53	4.53	4.56
query36	0.68	0.51	0.50
query37	0.12	0.07	0.06
query38	0.07	0.04	0.04
query39	0.05	0.03	0.03
query40	0.18	0.14	0.13
query41	0.08	0.03	0.03
query42	0.04	0.02	0.02
query43	0.05	0.04	0.03
Total cold run time: 97.63 s
Total hot run time: 27.27 s

doris-robot avatar Dec 09 '25 14:12 doris-robot

FE UT Coverage Report

Increment line coverage 85.71% (6/7) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 09 '25 14:12 hello-stephen

FE Regression Coverage Report

Increment line coverage 100.00% (7/7) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 09 '25 17:12 hello-stephen

FE Regression Coverage Report

Increment line coverage 100.00% (7/7) :tada: Increment coverage report Complete coverage report

hello-stephen avatar Dec 09 '25 17:12 hello-stephen

run buildall

seawinde avatar Dec 09 '25 23:12 seawinde

TPC-H: Total hot run time: 36253 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5b7946f66649a4451d184b29d3344871f19af2b7, data reload: false

------ Round 1 ----------------------------------
q1	17720	5083	4932	4932
q2	2081	351	250	250
q3	10123	1303	736	736
q4	10206	811	323	323
q5	7562	2163	1927	1927
q6	184	170	137	137
q7	1024	854	728	728
q8	9370	1399	1118	1118
q9	6962	5335	5322	5322
q10	6822	2381	1999	1999
q11	530	325	288	288
q12	648	740	591	591
q13	17775	3684	3034	3034
q14	284	296	275	275
q15	585	512	517	512
q16	933	914	863	863
q17	737	886	451	451
q18	7506	7175	7077	7077
q19	1136	946	619	619
q20	393	355	257	257
q21	4254	3836	3879	3836
q22	1050	995	978	978
Total cold run time: 107885 ms
Total hot run time: 36253 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4938	4916	4880	4880
q2	335	382	311	311
q3	2118	2705	2295	2295
q4	1311	1751	1290	1290
q5	4761	4777	4491	4491
q6	221	168	132	132
q7	2018	1922	1854	1854
q8	2631	2616	2546	2546
q9	7568	7530	7437	7437
q10	2989	3385	2904	2904
q11	584	514	477	477
q12	696	753	618	618
q13	3600	3812	3372	3372
q14	298	297	294	294
q15	552	505	510	505
q16	900	915	893	893
q17	1193	1443	1445	1443
q18	8021	7820	7632	7632
q19	822	775	812	775
q20	1901	1967	1800	1800
q21	4541	4261	4211	4211
q22	1065	1023	991	991
Total cold run time: 53063 ms
Total hot run time: 51151 ms

doris-robot avatar Dec 10 '25 00:12 doris-robot

TPC-DS: Total hot run time: 181869 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5b7946f66649a4451d184b29d3344871f19af2b7, data reload: false

query5	5143	627	481	481
query6	329	221	224	221
query7	4227	466	286	286
query8	313	244	236	236
query9	8758	2645	2639	2639
query10	557	367	333	333
query11	15388	15077	14557	14557
query12	192	146	119	119
query13	1246	495	389	389
query14	6674	3301	3086	3086
query14_1	2893	2908	2961	2908
query15	211	199	183	183
query16	878	484	466	466
query17	1128	699	577	577
query18	2751	434	351	351
query19	262	232	207	207
query20	123	120	110	110
query21	227	138	122	122
query22	3934	4030	3852	3852
query23	16373	16349	15956	15956
query23_1	16037	16078	16281	16078
query24	7264	1630	1234	1234
query24_1	1238	1250	1255	1250
query25	542	455	410	410
query26	1250	274	172	172
query27	2746	466	309	309
query28	4514	2167	2157	2157
query29	806	542	481	481
query30	308	233	214	214
query31	808	709	626	626
query32	75	70	70	70
query33	540	345	281	281
query34	892	911	545	545
query35	779	814	737	737
query36	872	907	833	833
query37	133	95	81	81
query38	3823	3878	3786	3786
query39	738	727	747	727
query39_1	716	691	707	691
query40	224	140	119	119
query41	66	62	64	62
query42	107	105	101	101
query43	425	432	393	393
query44	1319	770	766	766
query45	192	189	190	189
query46	878	972	625	625
query47	1678	1712	1604	1604
query48	321	338	248	248
query49	631	419	388	388
query50	654	295	220	220
query51	3847	3944	3810	3810
query52	107	111	99	99
query53	324	354	299	299
query54	289	269	253	253
query55	76	76	71	71
query56	295	319	303	303
query57	1151	1157	1087	1087
query58	277	265	258	258
query59	2292	2379	2283	2283
query60	308	342	289	289
query61	155	156	157	156
query62	680	675	624	624
query63	329	299	302	299
query64	4908	1289	1061	1061
query65	4032	3972	3974	3972
query66	1393	449	367	367
query67	15011	15256	14948	14948
query68	2745	1069	805	805
query69	448	350	321	321
query70	1060	1033	951	951
query71	341	314	290	290
query72	6380	5141	5038	5038
query73	477	548	308	308
query74	8946	8814	8542	8542
query75	3495	3553	3202	3202
query76	2927	1165	768	768
query77	412	395	326	326
query78	9598	9734	8910	8910
query79	1116	884	629	629
query80	1345	649	557	557
query81	553	264	247	247
query82	1031	129	113	113
query83	382	268	239	239
query84	258	123	96	96
query85	1051	508	452	452
query86	405	300	302	300
query87	4147	4053	3970	3970
query88	3239	2295	2294	2294
query89	466	418	388	388
query90	1915	157	162	157
query91	175	161	142	142
query92	68	73	67	67
query93	1075	941	583	583
query94	539	303	277	277
query95	568	318	310	310
query96	592	466	207	207
query97	2648	2667	2589	2589
query98	205	198	192	192
query99	1298	1299	1204	1204
Total cold run time: 257376 ms
Total hot run time: 181869 ms

doris-robot avatar Dec 10 '25 00:12 doris-robot

ClickBench: Total hot run time: 27.77 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5b7946f66649a4451d184b29d3344871f19af2b7, data reload: false

query1	0.06	0.05	0.05
query2	0.10	0.05	0.04
query3	0.26	0.09	0.09
query4	1.61	0.11	0.11
query5	0.28	0.25	0.27
query6	1.15	0.64	0.63
query7	0.03	0.03	0.03
query8	0.06	0.04	0.05
query9	0.56	0.51	0.49
query10	0.56	0.56	0.54
query11	0.17	0.11	0.12
query12	0.15	0.12	0.12
query13	0.62	0.61	0.60
query14	1.00	0.98	0.98
query15	0.81	0.78	0.81
query16	0.39	0.41	0.39
query17	1.08	1.00	1.04
query18	0.23	0.21	0.21
query19	1.94	1.88	1.89
query20	0.02	0.01	0.01
query21	15.44	0.30	0.14
query22	4.88	0.05	0.04
query23	16.06	0.27	0.11
query24	0.93	0.57	0.58
query25	0.11	0.09	0.06
query26	0.14	0.14	0.14
query27	0.08	0.04	0.06
query28	4.46	1.24	1.04
query29	12.62	4.06	3.35
query30	0.27	0.14	0.11
query31	2.83	0.63	0.41
query32	3.23	0.55	0.46
query33	3.17	3.03	3.09
query34	16.84	5.24	4.55
query35	4.52	4.54	4.56
query36	0.67	0.50	0.48
query37	0.12	0.07	0.07
query38	0.07	0.05	0.03
query39	0.04	0.03	0.03
query40	0.18	0.14	0.14
query41	0.09	0.03	0.03
query42	0.04	0.03	0.02
query43	0.05	0.04	0.03
Total cold run time: 97.92 s
Total hot run time: 27.77 s

doris-robot avatar Dec 10 '25 00:12 doris-robot

PR approved by anyone and no changes requested.

github-actions[bot] avatar Dec 11 '25 03:12 github-actions[bot]