opendal icon indicating copy to clipboard operation
opendal copied to clipboard

Idea: Add services support HBase/OBKV

Open WenyXu opened this issue 1 year ago • 8 comments

We are considering using OpenDAL to access OBKV(OceanBase storage layer; it could be considered HBase-compatible)

There is a rust obkv-table-client-rs, which we can rely on, but it uses a nightly rust version(maybe we can change it to a stable version)

WenyXu avatar Jan 05 '24 07:01 WenyXu

For the obkv-table-client-rs, my colleague may have more details. cc @fengjiachun

WenyXu avatar Jan 05 '24 07:01 WenyXu

Interestingly, I created the OpenDAL KV adapter just for fun, but now it's actually being used!

Xuanwo avatar Jan 05 '24 08:01 Xuanwo

I'm fine to add both obkv/hbase services, as long as:

  • The newly added dep is well-maintained
  • CI passed (with stable rust)
  • Test passed

Xuanwo avatar Jan 05 '24 08:01 Xuanwo

  • CI passed (with stable rust)

For this, I submitted https://github.com/oceanbase/obkv-table-client-rs/pull/87

Xuanwo avatar Jan 05 '24 09:01 Xuanwo

This is a related PR https://github.com/oceanbase/obkv-table-client-rs/pull/82

I ever thought about this and blocked because I cannot prepare a CI env for debugging and regression testing.

tisonkun avatar Jan 11 '24 01:01 tisonkun

I cannot prepare a CI env for debugging and regression testing.

Oh, this might be an issue.

Xuanwo avatar Jan 11 '24 02:01 Xuanwo

This is a related PR oceanbase/obkv-table-client-rs#82

I ever thought about this and blocked because I cannot prepare a CI env for debugging and regression testing.

Maybe we could implement CI for debugging and regression now. The Rust client server now supports 4.x server and we have a light observer in docker now (oceanbase/oceanbase-ce imageTag = "4.2.1_bp2"). See here for details.

IHEII avatar Jan 12 '24 09:01 IHEII

https://github.com/apache/incubator-horaedb/blob/main/src/components/object_store/src/obkv/mod.rs

HoraeDB already have an object store implementation based on OBKV, this maybe useful for this issue.

jiacai2050 avatar Feb 23 '24 03:02 jiacai2050