rocksplicator icon indicating copy to clipboard operation
rocksplicator copied to clipboard

Does rocksplicator have rocksdb coloumn family support?

Open anip30 opened this issue 8 years ago • 6 comments

We already have rocksdb instances which uses column family. We want to replicate those using rocksplicator. Is it possible?

anip30 avatar Oct 04 '17 00:10 anip30

Multiple column families within the same db instance share the same WAL, and the WriteBatch(BatchResult) read from GetUpdatesSince() has the column family info associated with each Update. So I guess it works for dbs with multiple column families.

newpoo avatar Oct 04 '17 00:10 newpoo

rocksplicator open the db using "auto s = rocksdb::DB::Open(options, dir, &db);" but if you have coloumn families you need to use "static Status Open(const DBOptions& db_options, const std::string& name, const std::vector<ColumnFamilyDescriptor>& column_families, std::vector<ColumnFamilyHandle*>* handles, DB** dbptr);"

what you think about that?

anip30 avatar Oct 04 '17 01:10 anip30

I was talking more about the core replicating logic, which has no problem to replicate DBs with multiple column families. Changes are required in the admin side to support column families. Unfortunately, we don't have any resource to work on it immediately.

newpoo avatar Oct 04 '17 01:10 newpoo

I am using only rocksdb_replicator from whole package. Can it replicate DB with Column families without any change in the code? I think it can.

anip30 avatar Oct 10 '17 05:10 anip30

Hi @newpoo @anip30 ,

Any updates on whether multiple column families are supported in rocksplicator? If so, how?

Thanks.

krithikagopalakrishnan avatar Aug 12 '19 10:08 krithikagopalakrishnan

Unfortunately, we haven't implemented it yet as of today.

newpoo avatar Aug 12 '19 19:08 newpoo