doris icon indicating copy to clipboard operation
doris copied to clipboard

Release Note 1.1.1

Open yiguolei opened this issue 3 years ago • 5 comments

Release Note 1.1.1

Upgrade Notes

None

Features

1. Support ODBC Sink in Vectorized Engine.

This feature is enabled in non-vectorized engine but it is missed in vectorized engine in 1.1. So that we add back this feature in 1.1.1.

2. Simple Memtracker for Vectorized Engine.

There is no memtracker in BE for vectorized engine in 1.1, so that the memory is out of control and cause OOM. In 1.1.1, a simple memtracker is added to BE and could control the memory and cancel the query when memory exceeded.

Improvements

1. Cache decompressed data in page cache.

Some data is compressed using bitshuffle and it costs a lot of time to decompress it during query. In 1.1.1, doris will decompress the data that encoded by bitshuffle to accelerate query and we find it could reduce 30% latency for some query in ssb-flat.

Bug Fix

1. Fix the problem that could not do rolling upgrade from 1.0.(Serious)

This issue was introduced in version 1.1 and may cause BE core when upgrade BE but not upgrade FE.

If you encounter this problem, you can try to fix it with #10833.

2. Fix the problem that some query not fall back to non-vectorized engine, and BE will core.

Currently, vectorized engine could not deal with all sql queries and some queries (like left outer join) will use non-vectorized engine to run. But there are some cases not covered in 1.1. And it will cause be crash.

3. Compaction not work correctly and cause -235 Error.

One rowset multi segments in uniq key compaction, segments rows will be merged in generic_iterator but merged_rows not increased. Compaction will failed in check_correctness, and make a tablet with too much versions which lead to -235 load error.

4. Some segment fault cases during query.

#10961 #10954 #10962

Behavior Changes

None.

Thanks

Thanks to everyone who has contributed to this release: @jacktengg @mrhhsg @xinyiZzz @yixiutt @starocean999 @morrySnow @morningman @HappenLee

yiguolei avatar Jul 22 '22 08:07 yiguolei

Has the version include https://github.com/apache/doris/pull/11033 ?

kkfnui avatar Jul 22 '22 10:07 kkfnui

Has the version include #11033 ?

Yes

kpfly avatar Jul 22 '22 10:07 kpfly

Maybe https://github.com/apache/doris/pull/11033 should be added in release note. @yiguolei

kpfly avatar Jul 25 '22 03:07 kpfly

Which pkg should i choose doris in v1.1.1 between java version 8 and version 11? In Doris v1.1.0, It is separate into two different package

Zu3zz avatar Aug 09 '22 02:08 Zu3zz

Release Note 1.1.1

Upgrade Notes

None

Features

1. Support ODBC Sink in Vectorized Engine.

This feature is enabled in non-vectorized engine but it is missed in vectorized engine in 1.1. So that we add back this feature in 1.1.1.

2. Simple Memtracker for Vectorized Engine.

There is no memtracker in BE for vectorized engine in 1.1, so that the memory is out of control and cause OOM. In 1.1.1, a simple memtracker is added to BE and could control the memory and cancel the query when memory exceeded.

Improvements

1. Cache decompressed data in page cache.

Some data is compressed using bitshuffle and it costs a lot of time to decompress it during query. In 1.1.1, doris will decompress the data that encoded by bitshuffle to accelerate query and we find it could reduce 30% latency for some query in ssb-flat.

Bug Fix

1. Fix the problem that could not do rolling upgrade from 1.0.(Serious)

This issue was introduced in version 1.1 and may cause BE core when upgrade BE but not upgrade FE.

If you encounter this problem, you can try to fix it with #10833.

2. Fix the problem that some query not fall back to non-vectorized engine, and BE will core.

Currently, vectorized engine could not deal with all sql queries and some queries (like left outer join) will use non-vectorized engine to run. But there are some cases not covered in 1.1. And it will cause be crash.

3. Compaction not work correctly and cause -235 Error.

One rowset multi segments in uniq key compaction, segments rows will be merged in generic_iterator but merged_rows not increased. Compaction will failed in check_correctness, and make a tablet with too much versions which lead to -235 load error.

4. Some segment fault cases during query.

#10961 #10954 #10962

JDK 8.

yiguolei avatar Aug 11 '22 04:08 yiguolei