parquet-format icon indicating copy to clipboard operation
parquet-format copied to clipboard

[Doc] Add implementation status / matrix

Open asfimport opened this issue 2 years ago • 7 comments

In Apache Arrow we have a documentation page listed the feature status for various implementations of Arrow: https://arrow.apache.org/docs/status.html

It could be nice to have a similar page for the main Parquet implementations (at least Java, C++, Rust).

The main downside is that it needs to be kept up to date.

Reporter: Antoine Pitrou / @pitrou

PRs and other links:

Note: This issue was originally created as PARQUET-2310. Please see the migration documentation for further details.

asfimport avatar Jun 15 '23 14:06 asfimport

Antoine Pitrou / @pitrou: cc @wgtmac @gszadovszky @alippai

asfimport avatar Jun 15 '23 14:06 asfimport

Antoine Pitrou / @pitrou: This was originally proposed in https://github.com/apache/arrow/pull/36027

asfimport avatar Jun 15 '23 14:06 asfimport

Andrew Lamb / @alamb: Examples from [~crepererum] on https://github.com/apache/parquet-site/pull/59#discussion_r1599844055

asfimport avatar May 14 '24 12:05 asfimport

Andrew Lamb / @alamb: I am interested in helping this issue. Once https://github.com/apache/parquet-site/pull/53 is merged I think we can begin work. Per https://github.com/apache/parquet-site/pull/34#issuecomment-2098269154 I think @alippai  plans to draft it

asfimport avatar May 14 '24 12:05 asfimport

I noticed https://parquet.apache.org/docs/file-format/implementationstatus/ is empty which confused me until I read https://github.com/apache/parquet-site/pull/34 and ended up here. I'm also interested in seeing this page filled in and could help.

@alippai: Do you have a draft in progress for this?

amoeba avatar Jan 29 '25 21:01 amoeba

I'll try to update the site for parquet-cpp and parquet-java later this month.

Update: created https://github.com/apache/parquet-site/pull/100

wgtmac avatar Feb 02 '25 11:02 wgtmac

I'm planning to make a pass for Rust once https://github.com/apache/parquet-site/pull/100 is merged. See https://github.com/apache/arrow-rs/issues/7088

etseidl avatar Feb 06 '25 19:02 etseidl

I believe this issue is now complete. The compatibility matrix page is here:

  • https://parquet.apache.org/docs/file-format/implementationstatus/

@pitrou if you agree, as the original reporter, perhaps you can close this issue (I do not have write access to this repository and thus can not close the ticket)

alamb avatar Aug 18 '25 10:08 alamb

That is great! Thanks a lot to all those who made this happen :)

pitrou avatar Aug 18 '25 11:08 pitrou