python-bloomfilter
python-bloomfilter copied to clipboard
joseph-fox
Scalable Bloom Filter implemented in Python
Hello. I need to load several files from disk into one, how should I do it? None of the options below worked ``` def load_bloom_filter(directory): bloom_filter = None for filename...
Really a non-cryptographic hash such as https://github.com/hajimes/mmh3 should be used. I guess this could be made the default for new filter objects and then a tag could be added to...
The following sample code has been executed on both python 2 and python 3 with the same result ``` from pybloom_live import BloomFilter if __name__ == '__main__': bf1 = BloomFilter(capacity=1000,...
Hi all: I'm getting segment fault when I try to run the following code ``` In [1]: import pybloom_live In [2]: bf = pybloom_live.BloomFilter(capacity=pow(10, 11), error_rate=0.001) Segmentation fault (core dumped)...
The module works great and thanks for enhancing the original BF in python @joseph-fox! I have two questions: - How can we derive the number of hash functions that was...
``` python from pybloom_live import BloomFilter, ScalableBloomFilter def test_bf(): error_rate = 0.01 capacity = 5000 bf = BloomFilter(capacity, 0.01) items = list(range(capacity)) for i in items: bf.add(i) test_items = list(range(bf.num_bits))...
Once you deserialize a serialized `BloomFilter` object the `self.bitarray` length might differ because of added padding. This is handled in this line https://github.com/joseph-fox/python-bloomfilter/blob/master/pybloom_live/pybloom.py#L216 Here difference in length due to the...
