parquet-tools

parquet-tools copied to clipboard

https://github.com/apache/parquet-format

ktrueda

When piping `parquet-tools csv` output to `less`, I consistently get a BrokenPipeError when `less` is closed: ``` > parquet-tools csv my.parquet | less Traceback (most recent call last): File "/.../bin/parquet-tools",...

maleasy

Schema command not working

2

I am not able to generate the schema for parquet file . Below is the error. parquet-tools schema Sample.parquet usage: parquet-tools [-h] {show,csv,inspect} ... **parquet-tools: error: argument {show,csv,inspect}: invalid choice:...

rohitprakash5

Fix #54

edef1c

It'd be great if you'd support moto 5.x. moto 5 brings some API changes, but seems to be much simpler overall.

flokli

If users specify multiple parquet files which has different column structure, the outcome is concat with column direction (not row direction). ```bash $ poetry run parquet-tools csv ./tests/test1.parquet ./tests/test0.parquet one,two,three,a,b,c,d...

ktrueda

csv export is nice, but if a text field contains itself the separator, the output then cannot be correctly interpreted 1. Exporting as JSON would alleviate the problem 2. Another...

rchevallier

Could be possible to have a parameter that behaves like truncate in spark.show()? Currently, if you try to show a data frame with a column that has a long string,...

set92

Add show meta

1

Showing row groups, the compression used, metadata and encoding. e.g. ``` docker run -v $PWD/houseprices:/data markhneedham/pq meta /data/house_prices.parquet File path: /data/house_prices.parquet Created by: parquet-cpp version 1.5.1-SNAPSHOT Properties: (none) Schema: message...

gingerwizard

It would be useful to print column sizes with `inspect`.

gingerwizard