parquet-tools
parquet-tools copied to clipboard
Setting to force length of columns (truncate in spark)
Could be possible to have a parameter that behaves like truncate in spark.show()?
Currently, if you try to show a data frame with a column that has a long string, or many columns, the shape of the data frame will break down, making it hard to read. Since I don't care about that column I could have 2 possibilities, use --columns
and select all columns except that one (maybe there could be a param that are directly the columns to be excluded?), or the other one could be truncating the length of columns, but couldn't find that option.