opendal icon indicating copy to clipboard operation
opendal copied to clipboard

new feature: Use hdfs jni directly instead of using `libhdfs`

Open Xuanwo opened this issue 1 year ago • 3 comments

Feature Description

libhdfs needs to call Java via Rust -> C -> Java, which introduces additional overhead. It might be more efficient to call JNI directly, bypassing the dependency on libhdfs.

Problem and Solution

Implement hdfs via jni directly without libhdfs.

Additional Context

It primarily seems like rewriting libhdfs in Rust.

Are you willing to contribute to the development of this feature?

  • [ ] Yes, I am willing to contribute to the development of this feature.

Xuanwo avatar Sep 13 '24 15:09 Xuanwo

~We don't use the 0.45.1+core.0.45.1 version pattern any more so it's now a non-issue.~

UPDATED - This is for https://github.com/apache/opendal/issues/4250 ...

tisonkun avatar Oct 08 '24 04:10 tisonkun

@Xuanwo I think it’s a fantastic enhancement. Could you let me know if this feature is currently under development? I’d appreciate any updates on its status!

oven-yang avatar Jun 13 '25 03:06 oven-yang

@Xuanwo I think it’s a fantastic enhancement. Could you let me know if this feature is currently under development? I’d appreciate any updates on its status!

Hi, no one has worked on this so far. I'm open to accepting any contributions.

Xuanwo avatar Jun 13 '25 03:06 Xuanwo