pybloomfiltermmap3 icon indicating copy to clipboard operation
pybloomfiltermmap3 copied to clipboard

Make in-memory bloomfilters pickle-able

Open stevesimmons opened this issue 4 years ago • 1 comments

The bloomfilters don't have reduce and setstate functions and so cannot be pickled. In particular, this prevents in-memory bloomfilters being used in multiprocessing.Pool or in cloud lambda functions, etc.

Do you have any plans to add these?

I guess the easiest way to do it is adding cython functions to read/write _bf.array.

stevesimmons avatar Oct 19 '20 09:10 stevesimmons

I had a go at solving this here: https://github.com/prashnts/pybloomfiltermmap3/pull/44

stevesimmons avatar Oct 19 '20 22:10 stevesimmons