connect icon indicating copy to clipboard operation
connect copied to clipboard

DRAFT Add probabilistic redis caches bloom and cuckoo for dedup/cached

Open peczenyj opened this issue 2 years ago • 0 comments

Hello

newer versions of redis stack server now have the probabilistic module enabled and we can use cuckoo and bloom filters

I start this development. to avoid repeating code I made some adjust in redis cache and using some adaptors we can use bloom or cuckoo instead the redis.UniversalClient

this is a preliminar version, very simple, and I need to improve the documentation

the intent is to work with https://github.com/benthosdev/benthos/pull/2028 using a multi cache hot local, in memory and cold in redis.

this MR can be combined with https://github.com/benthosdev/benthos/pull/2123 in the future

peczenyj avatar Sep 14 '23 16:09 peczenyj