doris icon indicating copy to clipboard operation
doris copied to clipboard

[Fix](inverted index) fix build index wrong size for inverted index

Open airborne12 opened this issue 1 year ago • 7 comments

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

airborne12 avatar May 24 '24 10:05 airborne12

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar May 24 '24 10:05 doris-robot

run buildall

airborne12 avatar May 24 '24 10:05 airborne12

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 24 '24 10:05 github-actions[bot]

TeamCity be ut coverage result: Function Coverage: 35.65% (9019/25297) Line Coverage: 27.31% (74580/273081) Region Coverage: 26.54% (38599/145448) Branch Coverage: 23.41% (19700/84148) Coverage Report: http://coverage.selectdb-in.cc/coverage/c903bc4ec1bb47ac9ab270c469e5777d2c01b684_c903bc4ec1bb47ac9ab270c469e5777d2c01b684/report/index.html

doris-robot avatar May 24 '24 10:05 doris-robot

TPC-H: Total hot run time: 41846 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c903bc4ec1bb47ac9ab270c469e5777d2c01b684, data reload: false

------ Round 1 ----------------------------------
q1	17589	4315	4207	4207
q2	2015	194	192	192
q3	10448	1245	1191	1191
q4	10184	869	759	759
q5	7483	2741	2715	2715
q6	236	133	130	130
q7	949	601	615	601
q8	9228	2114	2096	2096
q9	9316	6643	6649	6643
q10	9118	3921	3891	3891
q11	491	240	244	240
q12	479	242	230	230
q13	17336	3327	3171	3171
q14	267	251	229	229
q15	529	488	489	488
q16	528	414	426	414
q17	998	697	712	697
q18	8339	7821	7764	7764
q19	3850	1544	1556	1544
q20	636	312	317	312
q21	5281	4050	4121	4050
q22	365	287	282	282
Total cold run time: 115665 ms
Total hot run time: 41846 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4465	4419	4454	4419
q2	371	279	282	279
q3	3163	2932	2902	2902
q4	2004	1644	1602	1602
q5	5299	5487	5483	5483
q6	210	120	124	120
q7	2179	1825	1776	1776
q8	3232	3413	3380	3380
q9	8598	8598	8682	8598
q10	4043	3688	3741	3688
q11	587	487	501	487
q12	798	632	611	611
q13	16171	3135	3172	3135
q14	320	266	269	266
q15	535	485	480	480
q16	489	453	436	436
q17	1812	1532	1510	1510
q18	7832	7643	7380	7380
q19	1640	1566	1556	1556
q20	2051	1781	1818	1781
q21	4867	4751	4694	4694
q22	581	492	479	479
Total cold run time: 71247 ms
Total hot run time: 55062 ms

doris-robot avatar May 24 '24 10:05 doris-robot

TPC-DS: Total hot run time: 168725 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c903bc4ec1bb47ac9ab270c469e5777d2c01b684, data reload: false

query1	916	382	373	373
query2	7030	2312	2389	2312
query3	6643	203	207	203
query4	19822	17434	16917	16917
query5	4218	443	427	427
query6	240	163	167	163
query7	4596	303	292	292
query8	236	184	180	180
query9	8470	2405	2389	2389
query10	449	289	265	265
query11	10574	10057	10034	10034
query12	140	90	85	85
query13	1668	375	389	375
query14	9996	6804	7638	6804
query15	227	172	171	171
query16	7721	261	262	261
query17	1740	538	534	534
query18	1955	263	269	263
query19	197	158	157	157
query20	97	87	89	87
query21	197	131	129	129
query22	4180	3913	3867	3867
query23	33594	33153	33016	33016
query24	6872	2927	2809	2809
query25	569	355	362	355
query26	701	158	155	155
query27	2044	322	328	322
query28	3771	2056	2075	2056
query29	835	618	602	602
query30	226	169	181	169
query31	954	777	754	754
query32	86	57	55	55
query33	495	269	266	266
query34	861	481	483	481
query35	711	604	586	586
query36	1029	934	936	934
query37	109	70	71	70
query38	2908	2774	2788	2774
query39	831	787	789	787
query40	194	138	133	133
query41	49	47	44	44
query42	104	98	99	98
query43	621	565	535	535
query44	1126	745	767	745
query45	186	163	168	163
query46	1071	742	717	717
query47	1898	1754	1767	1754
query48	379	294	301	294
query49	845	384	376	376
query50	774	376	387	376
query51	6878	6684	6659	6659
query52	106	90	96	90
query53	355	289	295	289
query54	537	437	437	437
query55	77	73	72	72
query56	263	252	249	249
query57	1131	1059	1047	1047
query58	242	212	213	212
query59	3472	3313	3072	3072
query60	304	263	257	257
query61	89	85	88	85
query62	627	467	458	458
query63	320	289	286	286
query64	8444	2219	1775	1775
query65	3190	3097	3099	3097
query66	773	336	318	318
query67	15252	14763	14682	14682
query68	4502	544	549	544
query69	428	267	276	267
query70	1174	1123	1120	1120
query71	360	273	265	265
query72	7510	4360	2591	2591
query73	703	327	325	325
query74	6020	5624	5640	5624
query75	3328	2618	2610	2610
query76	2177	957	1114	957
query77	384	271	272	271
query78	10280	9724	9728	9724
query79	2087	530	548	530
query80	1125	508	436	436
query81	528	252	245	245
query82	671	95	98	95
query83	234	165	166	165
query84	247	86	83	83
query85	1560	271	258	258
query86	533	298	288	288
query87	3289	3154	3146	3146
query88	3986	2381	2350	2350
query89	477	383	385	383
query90	1989	186	186	186
query91	123	99	96	96
query92	59	50	47	47
query93	2818	530	512	512
query94	1215	183	185	183
query95	417	312	302	302
query96	604	264	261	261
query97	3141	3005	3017	3005
query98	252	223	217	217
query99	1224	840	845	840
Total cold run time: 260660 ms
Total hot run time: 168725 ms

doris-robot avatar May 24 '24 10:05 doris-robot

ClickBench: Total hot run time: 31.59 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c903bc4ec1bb47ac9ab270c469e5777d2c01b684, data reload: false

query1	0.05	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.66	0.09	0.10
query5	0.49	0.50	0.51
query6	1.12	0.73	0.72
query7	0.02	0.01	0.01
query8	0.05	0.04	0.05
query9	0.54	0.48	0.49
query10	0.54	0.53	0.54
query11	0.15	0.12	0.11
query12	0.15	0.11	0.12
query13	0.59	0.58	0.60
query14	0.78	0.77	0.80
query15	0.83	0.80	0.81
query16	0.37	0.35	0.37
query17	1.01	1.03	1.03
query18	0.21	0.25	0.24
query19	1.90	1.81	1.69
query20	0.02	0.01	0.01
query21	15.71	0.65	0.64
query22	4.63	6.40	2.89
query23	18.32	1.36	1.25
query24	1.49	0.31	0.22
query25	0.15	0.08	0.08
query26	0.26	0.16	0.17
query27	0.08	0.08	0.08
query28	13.50	1.00	0.98
query29	13.69	3.34	3.28
query30	0.25	0.06	0.05
query31	2.88	0.40	0.39
query32	3.26	0.47	0.47
query33	2.85	2.93	2.92
query34	17.21	4.39	4.40
query35	4.57	4.58	4.68
query36	0.65	0.46	0.46
query37	0.18	0.15	0.15
query38	0.14	0.14	0.14
query39	0.04	0.03	0.04
query40	0.16	0.15	0.14
query41	0.08	0.04	0.04
query42	0.05	0.05	0.04
query43	0.04	0.04	0.03
Total cold run time: 110.98 s
Total hot run time: 31.59 s

doris-robot avatar May 24 '24 10:05 doris-robot

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar May 27 '24 01:05 github-actions[bot]

PR approved by anyone and no changes requested.

github-actions[bot] avatar May 27 '24 01:05 github-actions[bot]