RocksDict
RocksDict copied to clipboard
Support for large data storage, and transformation
Can it support storage for large data as a database.How transformations and CRUD operations impact its latency factor.
I think it can support fairly large data size. It certainly is designed to store a large number of key-value pairs, especially when it cannot fit into the memory. For the specifics, refer to rocksdb, as this package is a thin wrapper around it.
How to allocate maximum memory for storage of large key value pairs?
What do you mean "allocate memory"?
Did you meet some storage limitation or some other issue?
When I am trying store huge data in key value pairs around 50 Million records my system crashes,is there a way to allocate some storage to Rdict to maximum limit
What’s the error message?
How many bytes are the keys and values on average, roughly? And are you sure that you have enough free disk space too?