opendal icon indicating copy to clipboard operation
opendal copied to clipboard

service: add Kubernetes service support

Open yangsoon opened this issue 1 year ago • 5 comments

Kubernetes (https://kubernetes.io/docs/home/) is an open source container orchestration engine. However, for end users, you can also consider Kubernetes as a configuration center. For example, creating a Pod resource is akin to inserting a configuration into the storage of Kubernetes.

Here is an example of how Kubernetes (k8s) can be integrated with OpenDAL

  1. read a k8s object just same as executing the kubectl get pod testA command.
op.read(pod.get_path())
  1. write a k8s object just same as executing the kubectl apply -f pod.yaml command.
op.write(pod.get_path(), pod)
  1. delete a k8s object just like executing the kubectl delete pod test
op.delete(pod.get_path())
  1. stat will return the metadata of k8s object

Last year, I implemented a tool https://github.com/yangsoon/kufu based on Rust that maps k8s (Kubernetes) objects to the local file system. In essence, it connects the file system's API to the k8s API. Therefore, I believe it is feasible to connect k8s to OpenDAL.

  1. kube rust client https://github.com/kube-rs/kube

yangsoon avatar Jun 03 '24 14:06 yangsoon

If there are no problems with adding this service, maybe can assign to me. cc @Xuanwo @Zheaoli

yangsoon avatar Jun 03 '24 14:06 yangsoon

No offense. Is it really worth doing this? Does anybody really read/write k8s through opendal instead k8s client?

nayihz avatar Jun 04 '24 10:06 nayihz

No offense. Is it really worth doing this? Does anybody really read/write k8s through opendal instead k8s client?

I strongly agree with your suggestion, so I also want to see what others think.

yangsoon avatar Jun 04 '24 13:06 yangsoon

Is it really worth doing this?

From my perspective, I don't consider whether it's worth it or not.

Instead, I focus on whether there are contributors interested in implementing and maintaining it. All services in OpenDAL are optional, and we will timely remove any that are poorly maintained.

As long as this service can be built, tested, and doesn't hinder our release process, I'm happy to integrate it.

So, if @yangsoon want to implement this, please feel free to get start.

Xuanwo avatar Jun 04 '24 13:06 Xuanwo

Is it really worth doing this?

From my perspective, I don't consider whether it's worth it or not.

Instead, I focus on whether there are contributors interested in implementing and maintaining it. All services in OpenDAL are optional, and we will timely remove any that are poorly maintained.

As long as this service can be built, tested, and doesn't hinder our release process, I'm happy to integrate it.

So, if @yangsoon want to implement this, please feel free to get start.

thanks,i will start as soon as possible

yangsoon avatar Jun 04 '24 15:06 yangsoon

No action required at this time, so I’m closing this for now. Please feel free to reopen it if you believe further work is needed.

Xuanwo avatar Apr 20 '25 05:04 Xuanwo