scio icon indicating copy to clipboard operation
scio copied to clipboard

Published 20 hours ago • verified publisher icon spotify

Support writing extra metadata in scio-parquet

Open clairemcginty opened this issue 1 week ago • 1 comments

Parquet 0.14 supports setting extra file metadata via ParquetWriter: https://github.com/apache/parquet-java/pull/1241

I added a new metadata output param to the scio-parquet Avro/Magnolify/Tensorflow bindings, which matches the naming convention we use in the scio-avro write APIs.

clairemcginty avatar Jun 27 '24 19:06 clairemcginty