doris icon indicating copy to clipboard operation
doris copied to clipboard

Release Note 1.1.2

Open yiguolei opened this issue 3 years ago • 5 comments

Release Note 1.1.2

v1.1.1 Release Note

Upgrade Notes

In this release, Doris Team has fixed more than 170 issues or performance improvement since 1.1.1. This release is a bugfix release on 1.1 and all users are encouraged to upgrade to this release.

Features

1. Introduced new memtracker for both vectorized engine and non-vectorized engine which is more accurate.

2. Add API for showing current queries and kill query.

3. Support read/write emoji of UTF16 via ODBC Table.

Improvements

1. Data Lake related improvements:

  • Improved HDFS ORC File scan performance about 300% . #11501

  • Support HDFS HA mode when query Iceberg Table.

  • Support query hive data created by Tez Engine.

  • Add Ali OSS as hive external support.

2. Add support for string and text type in Spark Load.

3. Add reuse block in non-vectorized engine, and have 50% performance improvement in some cases. #11392

4. Improve like or regex performance.

5. Disable tcmalloc's aggressive_memory_decommit which will have 40% performance gains in load or query.

Currently, it is a config, you can change it by set config tc_enable_aggressive_memory_decommit.

Bug Fix

1. Some issues about FE that will cause fe failure or data corrupt.

  • Add reserved disk config to avoid too many reserved BDB-JE files.(Serious) In an HA environment, BDB JE will retains as many reserved files. The BDB-je log doesn't delete until approaching a disk limit.

  • Fix fatal bug in BDB-JE which will cause FE replica could not start correctly or data corrupted. (Serious)

2. Fe will hang on waitFor_rpc during query and BE will hang in high concurrent scenarios.

#12459 #12458 #12392

3. A fatal issue in vectorized storage engine which will cause wrong result. (Serious)

#11754 #11694

4. Lots of planner related issues that will cause BE core or in abnormal state.

#12080 #12075 #12040 #12003 #12007 #11971 #11933 #11861 #11859 #11855 #11837 #11834 #11821 #11782 #11723 #11569

Behavior Changes

None.

yiguolei avatar Aug 26 '22 06:08 yiguolei

Well done.

spihiker avatar Sep 02 '22 01:09 spihiker

请问 1.1.2 啥时候能发布啊

1018ji avatar Sep 05 '22 09:09 1018ji

👏🤙

chovy-3012 avatar Sep 13 '22 08:09 chovy-3012

🤙

1018ji avatar Sep 13 '22 09:09 1018ji

hive external table ERROR 1105 (HY000): errCode = 2, detailMessage = ParseError : Read past EOF in DecompressionStream::readBuffer Slightly larger data, basically unavailable!!!

cnmrzhou avatar Sep 21 '22 07:09 cnmrzhou