Feature Request: Add support for locally deployed HDFS in datanode object storage

[4iKZ]

What problem does the new feature solve?

I'd like to inquire about when the datanode's object storage will support locally deployed HDFS. Currently, the object storage system supports several backends including File, S3, Oss, Azblob, and Gcs, but HDFS support is missing.

What does the feature do?

Many organizations already have locally deployed HDFS clusters for their big data infrastructure. Adding HDFS support to GreptimeDB's datanode would allow seamless integration with existing HDFS environments, enabling users to leverage their existing storage infrastructure without having to migrate to other object storage systems.

Implementation challenges

I noticed that GreptimeDB uses the OpenDAL library for object storage abstraction, and OpenDAL already supports HDFS. This suggests that adding HDFS support should be feasible by extending the existing object storage configuration system.

[killme2008]

@4iKZ Thanks for the suggestion. I think it’s worth doing.