orc icon indicating copy to clipboard operation
orc copied to clipboard
verified publisher icon apache

ORC-1608: Upgrade Hadoop to 3.4.0

Open dongjoon-hyun opened this issue 2 years ago • 5 comments

What changes were proposed in this pull request?

Why are the changes needed?

How was this patch tested?

Was this patch authored or co-authored using generative AI tooling?

dongjoon-hyun avatar Feb 04 '24 03:02 dongjoon-hyun

It seems okay except Javadoc.

dongjoon-hyun avatar Feb 04 '24 04:02 dongjoon-hyun

This is WIP because this PR is testing Apache Hadoop 3.4.0 RC2.

https://lists.apache.org/thread/cp2fc9w334rkd7ko9dwsodnhfg1sqxhs

dongjoon-hyun avatar Mar 04 '24 21:03 dongjoon-hyun

It seems to be deleted already for RC3.

Screenshot 2024-03-04 at 13 36 06

dongjoon-hyun avatar Mar 04 '24 21:03 dongjoon-hyun

This is WIP because this PR is testing Apache Hadoop 3.4.0 RC3.

  • https://lists.apache.org/thread/f8j83jlf0trtnknhfhg235zcn5tk7oqo

dongjoon-hyun avatar Mar 09 '24 00:03 dongjoon-hyun

For the record, I casted +1 for Hadoop 3.4.0 RC3.

  • https://lists.apache.org/thread/fwvz7yjw9mq8ns5yq43pzcn3fzjn5fsn

dongjoon-hyun avatar Mar 14 '24 16:03 dongjoon-hyun

Vote passed.

  • https://lists.apache.org/thread/6czr5o2st4m01od94mbqjqgrkwkq7p5d

dongjoon-hyun avatar Mar 17 '24 21:03 dongjoon-hyun

Thank you, @cxzl25 . This PR is still waiting for Apache Hadoop 3.4.0 API doc. It's not published yet.

dongjoon-hyun avatar Mar 19 '24 14:03 dongjoon-hyun

Javadoc generation passed.

Screenshot 2024-03-19 at 09 45 33

Merged to main for Apache ORC 2.1.0.

dongjoon-hyun avatar Mar 19 '24 16:03 dongjoon-hyun

For the record, I'm also working in the Apache Spark community with the following.

  • https://github.com/apache/spark/pull/45583

If needed, we are able to backport this to branch-2.0 and make Apache ORC 2.0.1 release.

dongjoon-hyun avatar Mar 19 '24 16:03 dongjoon-hyun

cc @wgtmac and @williamhyun , too.

dongjoon-hyun avatar Mar 19 '24 16:03 dongjoon-hyun