orc icon indicating copy to clipboard operation
orc copied to clipboard

ORC-1669: [C++] Upgrade libhdfs

Open ffacs opened this issue 1 year ago • 3 comments

What changes were proposed in this pull request?

Upgrade libhdfs.

Why are the changes needed?

To https://github.com/apache/orc/pull/1857

How was this patch tested?

UT passed

Was this patch authored or co-authored using generative AI tooling?

No

ffacs avatar Mar 27 '24 16:03 ffacs

CMake Error at /usr/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:165 (message):
  Could NOT find Boost (missing: Boost_INCLUDE_DIR date_time) (Required is at
  least version "1.72.0")

It seems that the latest version of libhdfspp has a dependency on boost, which we don't want to add to our dependencies.

The ORC C++ library usually is integrated into larger systems which have built-in filesystem implementation and simply adapt orc::InputStream to their parities. As libhdfspp has been introduced 7 years ago and has not been actively maintained, I'd propose to remove its support. @dongjoon-hyun @stiga-huang WDYT?

wgtmac avatar Mar 28 '24 02:03 wgtmac

It's too bad. Apache ORC community cannot remove it at ORC 2.x because ORC 2.0.0 is released already and we follow Semantic Versioning policy. The best thing we can do is to deprecate it at Apache ORC 2.0.1.

dongjoon-hyun avatar Mar 28 '24 16:03 dongjoon-hyun

That sounds good. Let me mark relevant code as deprecated first.

wgtmac avatar Mar 29 '24 01:03 wgtmac