parquet-tools icon indicating copy to clipboard operation
parquet-tools copied to clipboard

Setting to force length of columns (truncate in spark)

Open set92 opened this issue 1 year ago • 0 comments

Could be possible to have a parameter that behaves like truncate in spark.show()?

Currently, if you try to show a data frame with a column that has a long string, or many columns, the shape of the data frame will break down, making it hard to read. Since I don't care about that column I could have 2 possibilities, use --columns and select all columns except that one (maybe there could be a param that are directly the columns to be excluded?), or the other one could be truncating the length of columns, but couldn't find that option.

set92 avatar Apr 24 '23 15:04 set92