Feature Request: Create Index in Parallel

Open rockeet opened this issue 3 years ago • 3 comments

inplace_populate_sk scans tables, if a table is too large, this consumes too much time.

The table can be divided into multiple parts, one thread per-part, to speed up the scaning. Now RocksDB has ApproximateKeyAnchors, it can be used in the partition phase to sampling keys for partition bounds.

I'm not familiar with MyRocks to implement this feature.

Oct 05 '22 11:10 rockeet

I noticed InnoDB has option innodb_ddl_threads for this purpose, it is straight forward to implement this feature in myrocks.

Oct 20 '22 08:10 rockeet

Is there any progress?

Mar 01 '23 04:03 rockeet

This feature has been in our TODO list and may have some updates in H2.

Jun 07 '23 16:06 luqun