tera icon indicating copy to clipboard operation
tera copied to clipboard

use TabletWriter::Thread to load/unload/split TabletIO

Open 00k opened this issue 8 years ago • 3 comments

Now we use thread_pool to load/unload/split. Because of the limit of thread number, we have to control the concurrency. So when a ts restart, the load process is very slow. Every TabletIO has a TabletWriter, every TabletWriter has a thread. We could use that thread to do these work.

00k avatar Jan 10 '17 07:01 00k

we always need a concurrency control?

taocp avatar Jan 10 '17 07:01 taocp

Yes. But the thread number will not be out limitation any more. The concurrency could be very large, e.g. 100.

00k avatar Jan 10 '17 07:01 00k

why not TabletWriter shared in thread pool?

caijieming-ng avatar Jan 11 '17 02:01 caijieming-ng