gohbase icon indicating copy to clipboard operation
gohbase copied to clipboard

avoid cache avalanche

Open xpineal opened this issue 3 years ago • 2 comments

At the beginning of client start, there is no table region info in cache. If there are many go routine to access a table at same time, they will miss cache and send request package to get table region info. In this case, too many duplicated requests should be avoid.

xpineal avatar Feb 10 '22 11:02 xpineal

This looks similar to https://github.com/tsuna/gohbase/pull/164, not in the implementation but in what it tries to do.

dethi avatar Feb 10 '22 18:02 dethi

Discussed this with @dethi today and after looking at data on our clusters with @aaronbee we decided to add an option to the client to perform a cache warm up during initialization by preloading all entries from meta for tables of interest.

tsuna avatar Dec 12 '23 14:12 tsuna