Zaidoon Abd Al Hadi

Results 44 comments of Zaidoon Abd Al Hadi

is there a formula for calculating max memory usage? My initial understanding is that if set_cache_index_and_filter_blocks is set to true, then total memory usage by rocksdb can be calculated as...

I'm using jemalloc, I'll look into `dump_malloc_stats`

I may have misunderstood your question, in my LOG file i see: ``` block_cache_options: capacity : 33554432 num_shard_bits : 6 strict_capacity_limit : 0 memory_allocator : None high_pri_pool_ratio: 0.500 low_pri_pool_ratio: 0.000...

so i tried setting dump_malloc_stats but nothing shows up. Note that i'm doing this from rust so i'm using the c api to do this. rust code: ``` db_opts.enable_statistics(); db_opts.set_log_level(LogLevel::Info);...

correction, it turns out the rust crate by default doesn't build rocksdb with jemalloc and it gates it behind a feature flag so I actually wasn't using jemalloc for rocksdb...

so even after enabling the feature flag, I still don't see the stats. Just to make sure, the rust library tries to get rocksdb to use jemalloc by setting: ```...

update, the rust bindings are the problem as they were not actually getting rocksdb to use jemalloc. After fixing them locally, I can actually see the malloc stats. So i'll...

a feature request that might be helpful is to include in the LOG the allocator being used by rocksdb to make sure that users don't think they are using something...

@leeqx the rss memory i got from container_memory_rss{app_name=~"service_name.service"}. and other rocksdb memory usage metrics i got using https://github.com/zaidoon1/rust-rocksdb/blob/3e4a0f632a8c0c2839c7d183725c53895110d907/src/perf.rs#L267 Also update, after actually enabling jemalloc, I can confirm the memory issue...

I'm also interested in this feature, specifically, I would like to check if there exists a key that matches a prefix without having to seek, so this part ``` (at...