parquet-java icon indicating copy to clipboard operation
parquet-java copied to clipboard

PARQUET-1942: Bump Apache Arrow to 2.0.0

Open Fokko opened this issue 3 years ago • 4 comments

Make sure you have checked all steps below.

Jira

  • [ ] My PR addresses the following Parquet Jira issues and references them in the PR title. For example, "PARQUET-1234: My Parquet PR"
    • https://issues.apache.org/jira/browse/PARQUET-1942
    • In case you are adding a dependency, check if the license complies with the ASF 3rd Party License Policy.

Tests

  • [ ] My PR adds the following unit tests OR does not need testing for this extremely good reason:

Commits

  • [ ] My commits all reference Jira issues in their subject lines. In addition, my commits follow the guidelines from "How to write a good git commit message":
    1. Subject is separated from body by a blank line
    2. Subject is limited to 50 characters (not including Jira issue reference)
    3. Subject does not end with a period
    4. Subject uses the imperative mood ("add", not "adding")
    5. Body wraps at 72 characters
    6. Body explains "what" and "why", not "how"

Documentation

  • [ ] In case of new functionality, my PR adds documentation that describes how to use it.
    • All the public functions and the classes in the PR contain Javadoc that explain what it does

Fokko avatar Nov 01 '20 21:11 Fokko

@Fokko, It seems it still needs some additional work.

@martin-g, do you have an idea how it is possible that Travis did not fail because of this issue?

gszadovszky avatar Apr 09 '21 08:04 gszadovszky

@gszadovszky Checking ...

martin-g avatar Apr 12 '21 07:04 martin-g

@gszadovszky Fixed with https://github.com/apache/parquet-mr/pull/890

martin-g avatar Apr 12 '21 08:04 martin-g

@Fokko Could you please rebase from latest master so we can see that TravisCI fails too ?

martin-g avatar Apr 14 '21 12:04 martin-g

What's the status of this PR? Can we upgrade arrow as it's on a very old dependency and latest version has moved to 13.0.0 now ?

Let me know if I can help in any way ? :)

CC @Fokko @martin-g @gszadovszky

psilos avatar Oct 24 '23 08:10 psilos

@psilos You could help by creating a new PR with Arrow 13 and by making sure that the CI pass!

TravisCI is no more in use for testing on Linux ARM64! If the project is interested I could create a PR that uses the new ASF managed self-hosted runners at Github Actions!

martin-g avatar Oct 24 '23 08:10 martin-g

What's the status of this PR? Can we upgrade arrow as it's on a very old dependency and latest version has moved to 13.0.0 now ?

Let me know if I can help in any way ? :)

CC @Fokko @martin-g @gszadovszky

Do you want to create a PR for this? BTW, how do you use parquet-arrow in your case? @psilos

wgtmac avatar Oct 25 '23 01:10 wgtmac

Closing in favor of https://github.com/apache/parquet-mr/pull/1193

Fokko avatar Nov 14 '23 08:11 Fokko