keyhunt
keyhunt copied to clipboard
albertobsd
Reading and Loading bPtables from nvme disk
Hello Alberto,
nvme disks approaches RAM speed.
It is possible Keyhunt using nvme storage to process bsgs?
Thanks,
Ali G
Hello Alberto, isn't it the goal of the disk bloom filter? Thanks. Roberto
Hello Alberto, isn't it the goal of the disk bloom filter? Thanks. Roberto
Yes, but that project is in stand by, because i tested some functions of the Bloom filter directly in disk and it is slow, very very very very, i will test again in some NVMe disk server.
maybe can try the Key-Value Rocksdb?
I will make a test of it just to see if it fit to keyhunt, the project seems very good, also i like a lot the idea "especially suitable for storing multiple terabytes of data in a single database."
It is a key-value, also seems that is text only i need some more like index-value in binary format, but yes i need to test it.
Hello Alberto is it possible in xpoint mode to store the elements on a file and only the bloomfilter in RAM? I have read on other tread that you talk about that but for the bsgs mode but this option would be very usefull for xpoint... And if you find your files test for the disc bloom filter i would enjoy to give a try. Thanks. Roberto
@macsim26 im not sure about it.
How many elements are loading on xpoint mode and how much take the program in load those, maybe i can extend the -S for all the modes, this option is usefull only if you are loading some billions of elements or something like that.
After that if i enable some option to be read directly from disk i will let you know, but that option is a lot of work that is why i haven't started to develop it yet.