hui lai

[improve](routine-load) optimize routine load task schedule to make consume real-time and balanced

8

## Proposed changes If be slot is full, the task will be put in the end, causing the partition corresponding to this task will be delayed in consumption and consumption...

Replace unwrap error deal

2

When an error occurs, using unwrap will cause the program panic, and unwrap in the code needs to be replaced.

Encapsulate Linux native aio

1

We choose asynchronous io model to store file. First, the native aio of linux, which is supported by a relatively low kernel version, is encapsulated.And io_uring encapsulate later.

[improve](routine-load) add retry when get Kafka meta info

15

## Proposed changes If be down when FE send RPC `getInfo` or meet network error when be send RPC to Kafka, routine load job will pause. To keep routine load...

[improve](routine-load) use backoff algorithm in auto resume

22

## Proposed changes When some exception occur, such as `get offset failed ` for network isolation or be node down when upgrade, job will pause unexpectedly. Therefore, Doris introduce auto...

[fix](move-memtable) fix move memtable core when use multi table load

25

## Proposed changes Move memtable core when use multi table load: ``` 0x51f000c73860 is located 3040 bytes inside of 3456-byte region [0x51f000c72c80,0x51f000c73a00) freed by thread T4867 (FragmentMgrThre) here: #0 0x558f6ad7f43d...

[fix](routine-load) fix auto resume invalid when FE leader change

7

## Proposed changes We meet routine load pause and never be auto resume even if it meet the conditions. ``` Id: 134305 Name: lineitem_balance_dup_persistent_weekly_persistent_flow_weekly CreateTime: 2024-06-27 19:54:13 PauseTime: 2024-06-28 23:02:46...

define the API for hot-warm-cold data management, related issue: https://github.com/apache/skywalking/issues/11945

[fix](move-memtable) do not execute close if create rowset failed when loading MOW table

12

Core dump happened when load to MOW table: ``` Check failure stack trace: *** @ 0x55fae437d246 google::LogMessage::SendToLog() @ 0x55fae4379c90 google::LogMessage::Flush() @ 0x55fae437da89 google::LogMessageFatal::~LogMessageFatal() @ 0x55faacf26bbf doris::BaseTablet::check_delete_bitmap_correctness() @ 0x55fab05049ef doris::RowsetBuilder::commit_txn() @...

[fix](multi table) restrict the multi tables load memory under high concurrency with a large number of tables

38

BE node was killed by OOM-killer when use multi table load under high concurrency with a large number of tables(128 concurrency and every concurrency load 200 tables). This pr restricts...