Compaciton of pimaryKey model will use lot of memory if tablet have large many rows

[trueeyu]

Enhancement

tcmalloc: large alloc 1648500736 bytes == 0x78e9ee000 @ 0x4e93709 0x50113dc 0x1ce55e8 0x4f61c75 0x1bfe3ed 0x2e5250c 0x2e53689 0x2e3f06a 0x1c66c44 0x1c67e52 0x1c61081 0x1c5ee56 0x367c02e 0x3672a97 0x3673943 0x371a68e 0x37bf3ff 0x37b3971 terminate called recursively terminate called recursively terminate called recursively terminate called after throwing an instance of 'terminate called recursively terminate called recursively terminate called recursively *** Aborted at 1647570849 (unix time) try "date -d @1647570849" if you are using GNU date *** terminate called recursively std::bad_alloc' PC: @ 0x7f1a8edb3ca0 __GI_raise what(): std::bad_alloc*** SIGABRT (@0x206e) received by PID 8302 (TID 0x7f1963b0b700) from PID 8302; stack trace: ***

@          0x34fe482 google::(anonymous namespace)::FailureSignalHandler()
@     0x7f1a8fa9d7e0 (unknown)
@     0x7f1a8edb3ca0 __GI_raise
@     0x7f1a8edb5148 __GI_abort
@          0x4f62c72 __gnu_cxx::__verbose_terminate_handler()
@          0x4f61726 __cxxabiv1::__terminate()
@          0x4f61791 std::terminate()
@          0x4f618e4 __cxa_throw
@          0x1958a8b phmap::priv::raw_hash_set<>::resize()
@          0x1963aa3 phmap::priv::raw_hash_set<>::prepare_insert()
@          0x1963d65 starrocks::FixSliceHashIndex<>::upsert()
@          0x1939a39 starrocks::PrimaryIndex::upsert()
@          0x17ce001 starrocks::TabletUpdates::_apply_rowset_commit()
@          0x17d1fd4 starrocks::TabletUpdates::do_apply()
@          0x1d7455d starrocks::ThreadPool::dispatch_thread()
@          0x1d6fd78 starrocks::Thread::supervise_thread()
@     0x7f1a8fa9340b start_thread
@     0x7f1a8ee6d40f __GI___clone
@                0x0 (unknown)

start time: Fri Mar 18 10:35:02 CST 2022 tcmalloc: large alloc 1648500736 bytes == 0x8b37e8000 @ 0x4e93709 0x50113dc 0x1ce55e8 0x4f61c75 0x1bfe3ed 0x2e5250c 0x2e53689 0x2e3f06a 0x1c66c44 0x1c67e52 0x1c61081 0x1c5ee56 0x367c02e 0x3672a97 0x3673943 0x371a68e 0x37bf3ff 0x37b3971 tcmalloc: large alloc 3347611648 bytes == 0x916c0a000 @ 0x4e93709 0x50113dc 0x1ce55e8 0x4f61c75 0x1bfe3ed 0x2e5250c 0x2e53689 0x2e3f06a 0x1c66c44 0x1c67e52 0x1c61081 0x1c5ee56 0x367c02e 0x3672a97 0x3673943 0x371a68e 0x37bf3ff 0x37b3971 tcmalloc: large alloc 6798000128 bytes == 0x9dfc92000 @ 0x4e93709 0x50113dc 0x1ce55e8 0x4f61c75 0x1bfe3ed 0x2e5250c 0x2e53689 0x2e3f06a 0x1c66c44 0x1c67e52 0x1c61081 0x1c5ee56 0x367c02e 0x3672a97 0x3673943 0x371a68e 0x37bf3ff 0x37b3971 tcmalloc: large alloc 13804699648 bytes == 0xb77fa6000 @ 0x4e93709 0x50113dc 0x1ce55e8 0x4f61c75 0x1bfe3ed 0x2e5250c 0x2e53689 0x2e3f06a 0x1c66c44 0x1c67e52 0x1c61081 0x1c5ee56 0x367c02e 0x3672a97 0x3673943 0x371a68e 0x37bf3ff 0x37b3971

[github-actions[bot]]

We have marked this issue as stale because it has been inactive for 6 months. If this issue is still relevant, removing the stale label or adding a comment will keep it active. Otherwise, we'll close it in 10 days to keep the issue queue tidy. Thank you for your contribution to StarRocks!