asfimport

[Python] conversion from datetime objects with mixed timezones should normalize to UTC

2

Currently, when having objects with mixed timezones, they are each separately interpreted as their local time: ```python >>> ts_pd_paris = pd.Timestamp("1970-01-01 01:00", tz="Europe/Paris") >>> ts_pd_paris Timestamp('1970-01-01 01:00:00+0100', tz='Europe/Paris') >>> ts_pd_helsinki...

[CI] Build bundled dependencies in docker build step

6

In the recently introduced ARROW-5803, some heavy dependencies (thrift, protobuf, flatbufers, grpc) are build at each invocation of docker-compose build (thus each travis test). We should aim to build the...

[Developer][Documentation] Organize source and binary dependency licenses into directories

1

Similarly like Spark does, see comment https://github.com/apache/arrow/pull/4880/files/b839964a2a43123991b5b291607ff1cb026fe8a4#diff-61e0bdf7e1b43c5c93d9488b22e04170 **Reporter**: [Krisztian Szucs](https://issues.apache.org/jira/browse/ARROW-5954) / @kszucs **Note**: *This issue was originally created as [ARROW-5954](https://issues.apache.org/jira/browse/ARROW-5954). Please see the [migration documentation](https://github.com/apache/arrow/issues/14542) for further details.*

[C++][Parquet] Ability to concat parquet files

3

Ability to concat the parquet files is something we've wanted for some time too. When we generate parquet files partitioned by an expression, we often end up with tiny files...

[Release] Dockerize post-03-website.sh script

1

The script fails on OSX because of the BSD date function, and it also requires a recent git command to support -c flag of git shortlog and the installed jira...

Add option to reuse (Avro) objects when reading

3

Instead of creating an object for each record, Avro DatumReaders support passing in an object to be reused. It would be nice to expose this in Parquet. This could be...

zstd compressor and decompressor use the same configuration

1

I use spark to rewrite the parquet files that are compressed by zstd. And the parquet version is  1.12.2. I want to read the parquet files compressed by level 3...

Write parquet to STDOUT

2

https://github.com/Parquet/parquet-mr/blob/master/parquet-hadoop/src/main/java/parquet/hadoop/ParquetWriter.java I would like to write the parquet to stdout but there is no option to let me do this. Also the file must not already exist, or I' ll...

Cell Level Encryption

1

Cell level encryption can do finer-grained encryption than modular encryption(Parquet-1178) or file encryption. The idea is only some fields inside the column are encrypted based on a filter expression. For...

Proto-Parquet cannot write a schema with an empty group

1

This is valid protobuf:   ```java message Something {     EmptyMessage outerEmptyMessage = 1; } message EmptyMessage { } ``` However when we try to convert this to Parquet we get: ```java...