polars icon indicating copy to clipboard operation
polars copied to clipboard

Published 20 hours ago • verified publisher icon pola-rs

feat[rust]: impl ArrowGetItem for BinaryArray

Open ozgrakkurt opened this issue 1 year ago • 4 comments

ozgrakkurt avatar Sep 18 '22 09:09 ozgrakkurt

Polars does not support the Binary arrow type, so I don't really understand this PR?

ritchie46 avatar Sep 18 '22 11:09 ritchie46

I though it is supported because of the discussion here: https://github.com/pola-rs/polars/issues/4877

ozgrakkurt avatar Sep 18 '22 11:09 ozgrakkurt

I meant that you could use a ListType filled with u8 as a proxy type for binary.

ritchie46 avatar Sep 18 '22 11:09 ritchie46

would it make sense to add support for binary arrow type all around? It is more efficient to store in parquet files than just encoding binary data and putting into text

ozgrakkurt avatar Sep 18 '22 12:09 ozgrakkurt